Apr 13 20:23:14 devstack cinder-volume[72886]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 20:23:14 devstack cinder-volume[72886]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 20:23:14 devstack cinder-volume[72886]: we strongly recommend against using it for new projects.
Apr 13 20:23:14 devstack cinder-volume[72886]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 20:23:14 devstack cinder-volume[72886]: framework.  For more detail see
Apr 13 20:23:14 devstack cinder-volume[72886]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 20:23:14 devstack cinder-volume[72886]:   import eventlet  # noqa
Apr 13 20:23:15 devstack cinder-volume[72886]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 20:23:15 devstack cinder-volume[72886]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 20:23:15 devstack cinder-volume[72886]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 20:23:16 devstack cinder-volume[72886]: INFO dbcounter [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Registered counter for database cinder
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_db.sqlalchemy.engines [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG dbcounter [-] [72886] Writer thread running {{(pid=72886) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 20:23:16 devstack cinder-volume[72886]: INFO cinder.rpc [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 20:23:16 devstack cinder-volume[72886]: INFO cinder.rpc [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_db.sqlalchemy.engines [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:23:16 devstack cinder-volume[72886]: INFO cinder.volume.manager [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Determined volume DB was empty at startup.
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG cinder.volume.manager [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72886) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 20:23:16 devstack cinder-volume[72886]: INFO cinder.volume.manager [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 13 20:23:16 devstack cinder-volume[72886]: WARNING stevedore.named [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 20:23:16 devstack cinder-volume[72886]: WARNING castellan.key_manager [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 20:23:16 devstack cinder-volume[72886]: WARNING cinder.keymgr.conf_key_mgr [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG cinder.volume.drivers.lvm [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72886) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_concurrency.processutils [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72886) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_concurrency.processutils [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] CMD "cinder-rtstool verify" returned: 0 in 0.227s {{(pid=72886) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_db.sqlalchemy.engines [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:23:16 devstack cinder-volume[72886]: INFO cinder.rpc [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 13 20:23:16 devstack cinder-volume[72886]: INFO cinder.rpc [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 13 20:23:16 devstack cinder-volume[72886]: WARNING stevedore.named [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 20:23:16 devstack cinder-volume[72886]: WARNING castellan.key_manager [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 20:23:16 devstack cinder-volume[72886]: INFO cinder.volume.manager [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_db.sqlalchemy.engines [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:23:16 devstack cinder-volume[72886]: INFO oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Starting 1 workers
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Started child 72990 {{(pid=72886) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Full set of CONF: {{(pid=72886) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] ******************************************************************************** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Configuration options gathered from: {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] ================================================================================ {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] allow_availability_zone_fallback = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] allow_compression_on_image_upload = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] allowed_direct_url_schemes     = [] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] api_rate_limit                 = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] auth_strategy                  = keystone {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] az_cache_duration              = 3600 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_availability_zone      = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_host                   = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_name                   = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_stats_polling_interval = 60 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backup_api_class               = cinder.backup.api.API {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backup_name_template           = backup-%s {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backup_use_same_host           = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backup_use_temp_snapshot       = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] chap_password                  = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] chap_username                  =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cinder_internal_tenant_project_id = 6498b43de06140a59b09d14574fcff4b {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cinder_internal_tenant_user_id = d76fbc826b4f4a6a9bc326848ef24da4 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cloned_volume_same_az          = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cluster                        = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] compression_format             = gzip {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] config_dir                     = [] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] config_source                  = [] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] control_exchange               = openstack {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] debug                          = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] default_availability_zone      = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] default_group_type             = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72990]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] default_volume_type            = lvmdriver-1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] disk_geometry                  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] driver_client_cert             = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] driver_client_cert_key         = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] driver_data_namespace          = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] driver_ssl_cert_path           = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] driver_ssl_cert_verify         = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] driver_use_ssl                 = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] enable_force_upload            = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] enable_new_services            = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] enable_unsupported_driver      = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] enforce_multipath_for_image_xfer = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] filter_function                = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance_api_insecure            = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance_api_servers             = ['http://192.168.122.95/image'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance_api_ssl_compression     = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance_ca_certificates_file    = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance_certfile                = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance_keyfile                 = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance_num_retries             = 3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance_request_timeout         = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] goodness_function              = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] graceful_shutdown_timeout      = 5 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] group_api_class                = cinder.group.api.API {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] host                           = devstack {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] image_compress_on_upload       = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] image_conversion_address_space_limit = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] image_conversion_cpu_limit     = 60 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] image_conversion_disable       = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] image_upload_use_cinder_backend = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] image_upload_use_internal_tenant = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] image_volume_cache_enabled     = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] image_volume_cache_max_count   = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] image_volume_cache_max_size_gb = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] init_host_max_objects_retrieval = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] iscsi_target_flags             =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] iscsi_write_cache              = on {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] iser_helper                    = tgtadm {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] iser_ip_address                = 192.168.122.95 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] iser_port                      = 3260 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] log_color                      = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] log_config_append              = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] log_dir                        = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] log_file                       = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] log_options                    = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] log_rotate_interval            = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] log_rotate_interval_type       = days {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] log_rotation_type              = none {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] max_age                        = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] max_logfile_count              = 30 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] max_logfile_size_mb            = 200 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] max_over_subscription_ratio    = 20.0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] message_reap_interval          = 86400 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] message_ttl                    = 2592000 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] migration_create_volume_timeout_secs = 300 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] monkey_patch                   = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] monkey_patch_modules           = [] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] my_ip                          = 192.168.122.95 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] no_snapshot_gb_quota           = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] num_iser_scan_tries            = 3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] num_shell_tries                = 3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] num_volume_device_scan_tries   = 3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] nvmeof_conn_info_version       = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] nvmet_ns_id                    = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] nvmet_port_id                  = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] osapi_max_limit                = 1000 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] osapi_volume_ext_list          = [] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] osapi_volume_listen_port       = 8776 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] osapi_volume_use_ssl           = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] osapi_volume_workers           = 2 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] per_volume_size_limit          = -1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] periodic_fuzzy_delay           = 60 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] periodic_interval              = 60 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] public_endpoint                = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] publish_errors                 = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] quota_backup_gigabytes         = 1000 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] quota_backups                  = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] quota_gigabytes                = 1000 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] quota_groups                   = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] quota_snapshots                = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] quota_volumes                  = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] rate_limit_burst               = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] rate_limit_except_level        = CRITICAL {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] rate_limit_interval            = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] reinit_driver_count            = 3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] replication_device             = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] report_discard_supported       = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] report_interval                = 120 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] reservation_clean_interval     = 86400 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] reservation_expire             = 86400 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] reserved_image_namespaces      = [] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] reserved_percentage            = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] rpc_response_timeout           = 120 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] run_external_periodic_tasks    = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] scst_target_driver             = iscsi {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] scst_target_iqn_name           = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] service_down_time              = 720 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] shell_completion               = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] snapshot_name_template         = snapshot-%s {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] snapshot_same_host             = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] split_loggers                  = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] state_path                     = /opt/stack/data/cinder {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] storage_availability_zone      = nova {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] storage_protocol               = iSCSI {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] syslog_log_facility            = LOG_USER {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] target_helper                  = lioadm {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] target_ip_address              = 192.168.122.95 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] target_port                    = 3260 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] target_protocol                = iscsi {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] target_secondary_ip_addresses  = [] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] trace_flags                    = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] transport_url                  = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] until_refresh                  = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] use_chap_auth                  = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] use_default_quota_class        = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] use_journal                    = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] use_json                       = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] use_multipath_for_image_xfer   = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] use_stderr                     = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] use_syslog                     = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] verify_glance_signatures       = enabled {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_api_class               = cinder.volume.api.API {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_backend_name            = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_clear                   = zero {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_clear_ionice            = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_clear_size              = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_copy_bps_limit          = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_dd_blocksize            = 1M {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_name_template           = volume-%s {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_service_inithost_offload = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volume_usage_audit_period      = month {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] zoning_mode                    = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_concurrency.disable_process_locking = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.admin_password = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.admin_token = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.admin_user  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.auth_protocol = https {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.auth_section = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.auth_type   = password {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.auth_uri    = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.auth_version = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.cache       = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.certfile    = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.identity_uri = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.include_service_catalog = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.insecure    = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.interface   = public {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.keyfile     = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_password =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcache_username =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.region_name = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.service_type = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.backend                  = dogpile.cache.null {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.backend_argument         = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.backend_expiration_time  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.config_prefix            = cache.oslo {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.debug_cache_backend      = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.enable_retry_client      = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.enable_socket_keepalive  = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.enabled                  = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.enforce_fips_mode        = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.expiration_time          = 600 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.hashclient_retry_attempts = 2 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.memcache_dead_retry      = 300 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.memcache_sasl_enabled    = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.password                 = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.proxies                  = [] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.redis_db                 = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.redis_server             = localhost:6379 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.retry_attempts           = 2 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.retry_delay              = 0.0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.socket_keepalive_count   = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.socket_keepalive_idle    = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.socket_keepalive_interval = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.socket_timeout           = 1.0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.tls_allowed_ciphers      = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.tls_cafile               = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.tls_certfile             = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.tls_enabled              = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.tls_keyfile              = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cache.username                 = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] coordination.backend_url       = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.asyncio_connection    = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.asyncio_slave_connection = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.backend               = sqlalchemy {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.connection            = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.connection_debug      = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.connection_parameters =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.connection_recycle_time = 3600 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.connection_trace      = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.db_inc_retry_interval = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.db_max_retries        = 20 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.db_max_retry_interval = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.db_retry_interval     = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.max_overflow          = 50 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.max_pool_size         = 5 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.max_retries           = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.mysql_wsrep_sync_wait = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.pool_timeout          = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.retry_interval        = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.slave_connection      = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.sqlite_synchronous    = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.synchronous_reader    = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] database.use_db_reconnect      = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler.connection_string     = messaging:// {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler.enabled               = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler.es_doc_type           = notification {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler.es_scroll_size        = 10000 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler.es_scroll_time        = 2m {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler.filter_error_trace    = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler.hmac_keys             = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler.sentinel_service_name = mymaster {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler.socket_timeout        = 0.1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler.trace_requests        = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler.trace_sqlalchemy      = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler_jaeger.process_tags   = {} {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler_jaeger.service_name_prefix = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] profiler_otlp.service_name_prefix = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_policy.enforce_new_defaults = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: WARNING oslo_config.cfg [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_policy.enforce_scope      = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_policy.policy_default_rule = default {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] privsep_osbrick.group          = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] privsep_osbrick.helper_command = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] privsep_osbrick.user           = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cinder_sys_admin.group         = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cinder_sys_admin.helper_command = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] cinder_sys_admin.user          = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] service_user.auth_section      = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] service_user.auth_type         = password {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] service_user.cafile            = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] service_user.certfile          = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] service_user.collect_timing    = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] service_user.insecure          = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] service_user.keyfile           = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] service_user.send_service_user_token = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] service_user.split_loggers     = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] service_user.timeout           = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance.auth_section            = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance.auth_type               = password {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance.certfile                = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance.collect_timing          = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance.insecure                = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance.keyfile                 = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance.region_name             = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance.split_loggers           = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] glance.timeout                 = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.backend_availability_zone = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.chap_password = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.chap_username =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.disk_geometry = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.driver_client_cert = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.driver_client_cert_key = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.driver_data_namespace = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.driver_use_ssl = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.extra_capabilities = {} {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.filter_function = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.goodness_function = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.iscsi_target_flags =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.iscsi_write_cache = on {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.iser_port     = 3260 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.lvm_share_target = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.lvm_type      = auto {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.num_shell_tries = 3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.replication_device = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.report_discard_supported = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.reserved_percentage = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.target_helper = tgtadm {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.target_port   = 3260 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72990]: INFO cinder.volume.manager [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 13 20:23:16 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.target_protocol = iscsi {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.trace_flags   = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.unique_fqdn_network = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.use_chap_auth = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.volume_backend_name = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.volume_clear  = zero {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.volume_clear_ionice = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.volume_clear_size = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_reports.file_event_handler = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_reports.log_dir           = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.backend_host       = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.chap_password      = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.chap_username      = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.disk_geometry      = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.driver_client_cert = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.extra_capabilities = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.filter_function    = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.goodness_function  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.iser_helper        = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.iser_port          = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.lvm_type           = auto {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.replication_device = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.report_discard_supported = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.reserved_percentage = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.scst_target_driver = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.storage_protocol   = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:16 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.target_ip_address  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.target_port        = 3260 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.trace_flags        = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.volume_clear       = zero {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] lvmdriver-1.volumes_dir        = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_notifications.driver = [] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_notifications.retry = -1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] key_manager.fixed_key          = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.barbican_api_version  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.barbican_endpoint     = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.barbican_endpoint_type = public {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.barbican_region_name  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.cafile                = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.certfile              = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.collect_timing        = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.insecure              = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.keyfile               = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.number_of_retries     = 60 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.retry_delay           = 1 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.send_service_user_token = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.split_loggers         = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.timeout               = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.verify_ssl            = True {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican.verify_ssl_path       = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican_service_user.auth_section = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican_service_user.auth_type = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican_service_user.cafile   = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican_service_user.certfile = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican_service_user.collect_timing = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican_service_user.insecure = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican_service_user.keyfile  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican_service_user.split_loggers = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] barbican_service_user.timeout  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vault.approle_role_id          = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vault.approle_secret_id        = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vault.kv_mountpoint            = secret {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vault.kv_path                  = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vault.kv_version               = 2 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:16 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:16 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vault.namespace                = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:17 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:17 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vault.root_token_id            = **** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:17 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vault.ssl_ca_crt_file          = None {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:17 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vault.timeout                  = 60.0 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:17 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vault.use_ssl                  = False {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:17 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:23:17 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] ******************************************************************************** {{(pid=72886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 20:23:17 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:17 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:17 devstack sudo[72994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 13 20:23:17 devstack sudo[72994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:17 devstack sudo[72994]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:17 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.552s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:17 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:17 devstack sudo[73021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:23:17 devstack sudo[73021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:18 devstack sudo[73021]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:18 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.533s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:18 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:23:18 devstack cinder-volume[72990]: INFO cinder.brick.local_dev.lvm [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 13 20:23:18 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:18 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:18 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:18 devstack sudo[73283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 20:23:18 devstack sudo[73283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:18 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:18 devstack cinder-volume[72990]: DEBUG cinder.brick.local_dev.lvm [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72990) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 13 20:23:18 devstack sudo[73283]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:18 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:18 devstack sudo[73488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:23:18 devstack sudo[73488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:19 devstack sudo[73488]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:19 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.046s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:19 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:19 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:19 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:19 devstack sudo[73669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:23:19 devstack sudo[73669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:20 devstack sudo[73669]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:20 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.469s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:20 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:20 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:20 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:20 devstack sudo[73688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 13 20:23:20 devstack sudo[73688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:20 devstack sudo[73688]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:20 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.454s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:20 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:20 devstack sudo[73691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 20:23:20 devstack sudo[73691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:21 devstack sudo[73691]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:21 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:21 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:21 devstack sudo[73696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 20:23:21 devstack sudo[73696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:21 devstack sudo[73696]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:21 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:21 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:21 devstack sudo[73702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:23:21 devstack sudo[73702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:22 devstack sudo[73702]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:22 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:22 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:22 devstack sudo[73707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:23:22 devstack sudo[73707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:22 devstack sudo[73707]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:22 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.450s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:22 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:22 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:22 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:22 devstack sudo[73711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:23:22 devstack sudo[73711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:22 devstack sudo[73711]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:22 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.503s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:22 devstack cinder-volume[72990]: INFO cinder.volume.drivers.lvm [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 13 20:23:22 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:23 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:23 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:23 devstack sudo[73723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:23:23 devstack sudo[73723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:23 devstack sudo[73723]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:23 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:23 devstack cinder-volume[72990]: DEBUG cinder.volume.drivers.lvm [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Updating volume stats {{(pid=72990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 20:23:23 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:23 devstack sudo[73836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 20:23:23 devstack sudo[73836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:23 devstack sudo[73836]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:23 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:23 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:23 devstack sudo[73930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:23:23 devstack sudo[73930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:24 devstack sudo[73930]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:24 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:24 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:24 devstack sudo[73980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:23:24 devstack sudo[73980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:24 devstack sudo[73980]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:24 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.477s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:24 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:24 devstack sudo[73983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:23:24 devstack sudo[73983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:25 devstack sudo[73983]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:25 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:25 devstack cinder-volume[72990]: INFO cinder.volume.driver [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 20:23:25 devstack cinder-volume[72990]: DEBUG cinder.volume.driver [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72990) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 20:23:25 devstack cinder-volume[72990]: DEBUG oslo_db.sqlalchemy.engines [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72990) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:23:25 devstack cinder-volume[72990]: DEBUG dbcounter [-] [72990] Writer thread running {{(pid=72990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 20:23:25 devstack cinder-volume[72990]: DEBUG cinder.db.sqlalchemy.api [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Building query based on filter {{(pid=72990) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 20:23:25 devstack cinder-volume[72990]: DEBUG cinder.image.image_utils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72990) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 20:23:25 devstack cinder-volume[72990]: INFO cinder.keymgr.migration [None req-17182ac7-822e-441c-8236-ed1e4f52e874 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 20:23:25 devstack cinder-volume[72990]: DEBUG cinder.volume.drivers.lvm [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Updating volume stats {{(pid=72990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 20:23:25 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:25 devstack sudo[73988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 20:23:25 devstack sudo[73988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:25 devstack sudo[73988]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:25 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:25 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:25 devstack sudo[73994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:23:25 devstack sudo[73994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:26 devstack sudo[73994]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:26 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:26 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:26 devstack sudo[73998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:23:26 devstack sudo[73998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:26 devstack cinder-volume[72886]: DEBUG dbcounter [-] [72886] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72886) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:23:26 devstack sudo[73998]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:26 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:26 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:26 devstack sudo[74003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:23:26 devstack sudo[74003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:27 devstack sudo[74003]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:27 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:27 devstack cinder-volume[72990]: DEBUG cinder.manager [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Notifying Schedulers of capabilities ... {{(pid=72990) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:23:27 devstack cinder-volume[72990]: INFO cinder.volume.manager [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Driver initialization completed successfully.
Apr 13 20:23:27 devstack cinder-volume[72990]: INFO cinder.manager [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Initiating service 2 cleanup
Apr 13 20:23:27 devstack cinder-volume[72990]: INFO cinder.manager [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Service 2 cleanup completed.
Apr 13 20:23:27 devstack cinder-volume[72990]: DEBUG cinder.service [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Creating RPC server for service cinder-volume {{(pid=72990) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 20:23:27 devstack cinder-volume[72990]: DEBUG cinder.service [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72990) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 20:23:27 devstack cinder-volume[72990]: INFO cinder.volume.manager [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 13 20:23:27 devstack cinder-volume[72990]: DEBUG cinder.volume.drivers.lvm [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Updating volume stats {{(pid=72990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 20:23:27 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:27 devstack sudo[74011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 20:23:27 devstack sudo[74011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:27 devstack sudo[74011]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:27 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:27 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:27 devstack sudo[74064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:23:27 devstack sudo[74064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:28 devstack sudo[74064]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:28 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:28 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:28 devstack sudo[74071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:23:28 devstack sudo[74071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:28 devstack sudo[74071]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:28 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.441s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:28 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:23:28 devstack sudo[74074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:23:28 devstack sudo[74074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:23:29 devstack sudo[74074]: pam_unix(sudo:session): session closed for user root
Apr 13 20:23:29 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:23:29 devstack cinder-volume[72990]: INFO cinder.volume.manager [None req-5e6a72a2-d229-4691-a5d7-c4c4b9f6c71d None None] Driver post RPC initialization completed successfully.
Apr 13 20:23:39 devstack cinder-volume[72990]: DEBUG dbcounter [-] [72990] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:23:39 devstack cinder-volume[72990]: DEBUG dbcounter [-] [72990] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:24:29 devstack cinder-volume[72990]: DEBUG oslo_service.periodic_task [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:29 devstack cinder-volume[72990]: DEBUG cinder.volume.drivers.lvm [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Updating volume stats {{(pid=72990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 20:24:29 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:24:29 devstack sudo[78807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 20:24:29 devstack sudo[78807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:24:29 devstack sudo[78807]: pam_unix(sudo:session): session closed for user root
Apr 13 20:24:29 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:24:29 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:24:29 devstack sudo[78810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:24:29 devstack sudo[78810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:24:30 devstack sudo[78810]: pam_unix(sudo:session): session closed for user root
Apr 13 20:24:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:24:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:24:30 devstack sudo[78813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:24:30 devstack sudo[78813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:24:30 devstack sudo[78813]: pam_unix(sudo:session): session closed for user root
Apr 13 20:24:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:24:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:24:30 devstack sudo[78816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:24:30 devstack sudo[78816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:24:30 devstack sudo[78816]: pam_unix(sudo:session): session closed for user root
Apr 13 20:24:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:24:30 devstack cinder-volume[72990]: DEBUG cinder.manager [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Notifying Schedulers of capabilities ... {{(pid=72990) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:25:29 devstack cinder-volume[72990]: DEBUG oslo_service.periodic_task [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:25:29 devstack cinder-volume[72990]: DEBUG cinder.volume.drivers.lvm [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Updating volume stats {{(pid=72990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 20:25:29 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:25:29 devstack sudo[80111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 20:25:29 devstack sudo[80111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:25:29 devstack sudo[80111]: pam_unix(sudo:session): session closed for user root
Apr 13 20:25:29 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:25:29 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:25:29 devstack sudo[80114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:25:29 devstack sudo[80114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:25:30 devstack sudo[80114]: pam_unix(sudo:session): session closed for user root
Apr 13 20:25:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:25:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:25:30 devstack sudo[80121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:25:30 devstack sudo[80121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:25:30 devstack sudo[80121]: pam_unix(sudo:session): session closed for user root
Apr 13 20:25:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.479s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:25:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:25:30 devstack sudo[80178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:25:30 devstack sudo[80178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:25:31 devstack sudo[80178]: pam_unix(sudo:session): session closed for user root
Apr 13 20:25:31 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:25:31 devstack cinder-volume[72990]: DEBUG cinder.manager [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Notifying Schedulers of capabilities ... {{(pid=72990) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:25:39 devstack cinder-volume[72990]: DEBUG dbcounter [-] [72990] Writing DB stats cinder:SELECT=1 {{(pid=72990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:25:39 devstack cinder-volume[72990]: DEBUG dbcounter [-] [72990] Writing DB stats cinder:UPDATE=1 {{(pid=72990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:26:29 devstack cinder-volume[72990]: DEBUG oslo_service.periodic_task [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:26:29 devstack cinder-volume[72990]: DEBUG cinder.volume.drivers.lvm [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Updating volume stats {{(pid=72990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 20:26:29 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:26:29 devstack sudo[81731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 20:26:29 devstack sudo[81731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:26:29 devstack sudo[81731]: pam_unix(sudo:session): session closed for user root
Apr 13 20:26:29 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:26:29 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:26:29 devstack sudo[81755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:26:29 devstack sudo[81755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:26:30 devstack sudo[81755]: pam_unix(sudo:session): session closed for user root
Apr 13 20:26:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:26:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:26:30 devstack sudo[81759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 20:26:30 devstack sudo[81759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:26:30 devstack sudo[81759]: pam_unix(sudo:session): session closed for user root
Apr 13 20:26:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.452s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:26:30 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:26:30 devstack sudo[81763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 20:26:30 devstack sudo[81763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:26:31 devstack sudo[81763]: pam_unix(sudo:session): session closed for user root
Apr 13 20:26:31 devstack cinder-volume[72990]: DEBUG oslo_concurrency.processutils [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:26:31 devstack cinder-volume[72990]: DEBUG cinder.manager [None req-fc1733c6-fd37-42e1-ab6c-98f0eeb18024 None None] Notifying Schedulers of capabilities ... {{(pid=72990) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:26:50 devstack cinder-volume[72886]: INFO oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Caught SIGTERM, stopping children
Apr 13 20:26:50 devstack cinder-volume[72886]: DEBUG oslo_concurrency.lockutils [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Acquiring lock "singleton_lock" {{(pid=72886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 20:26:50 devstack cinder-volume[72886]: DEBUG oslo_concurrency.lockutils [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Acquired lock "singleton_lock" {{(pid=72886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 20:26:50 devstack cinder-volume[72886]: DEBUG oslo_concurrency.lockutils [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Releasing lock "singleton_lock" {{(pid=72886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 20:26:50 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Stop services. {{(pid=72886) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 13 20:26:50 devstack cinder-volume[72886]: DEBUG oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Killing children. {{(pid=72886) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 13 20:26:50 devstack cinder-volume[72886]: INFO oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Waiting on 1 children to exit
Apr 13 20:26:52 devstack cinder-volume[72990]: DEBUG oslo_concurrency.lockutils [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Acquiring lock "singleton_lock" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 20:26:52 devstack cinder-volume[72990]: DEBUG oslo_concurrency.lockutils [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Acquired lock "singleton_lock" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 20:26:52 devstack cinder-volume[72990]: DEBUG oslo_concurrency.lockutils [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Releasing lock "singleton_lock" {{(pid=72990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 20:26:52 devstack cinder-volume[72990]: WARNING amqp [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 20:26:52 devstack cinder-volume[72990]: WARNING amqp [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 20:26:52 devstack cinder-volume[72886]: INFO oslo_service.backend._eventlet.service [None req-70bd6a92-4bf9-4627-a5c7-c151a66e1844 None None] Child 72990 exited with status 0
Apr 13 20:26:52 devstack cinder-volume[82275]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 20:26:52 devstack cinder-volume[82275]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 20:26:52 devstack cinder-volume[82275]: we strongly recommend against using it for new projects.
Apr 13 20:26:52 devstack cinder-volume[82275]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 20:26:52 devstack cinder-volume[82275]: framework.  For more detail see
Apr 13 20:26:52 devstack cinder-volume[82275]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 20:26:52 devstack cinder-volume[82275]:   import eventlet  # noqa
Apr 13 20:26:54 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82275) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 20:26:54 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82275) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 20:26:54 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82275) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 20:26:55 devstack cinder-volume[82275]: INFO dbcounter [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Registered counter for database cinder
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_db.sqlalchemy.engines [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82275) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG dbcounter [-] [82275] Writer thread running {{(pid=82275) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 20:26:55 devstack cinder-volume[82275]: INFO cinder.rpc [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 20:26:55 devstack cinder-volume[82275]: INFO cinder.rpc [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_db.sqlalchemy.engines [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82275) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:26:55 devstack cinder-volume[82275]: INFO cinder.volume.manager [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Determined volume DB was empty at startup.
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG cinder.volume.manager [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82275) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 20:26:55 devstack cinder-volume[82275]: INFO cinder.volume.manager [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 13 20:26:55 devstack cinder-volume[82275]: WARNING stevedore.named [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 20:26:55 devstack cinder-volume[82275]: WARNING castellan.key_manager [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 20:26:55 devstack cinder-volume[82275]: WARNING cinder.keymgr.conf_key_mgr [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 20:26:55 devstack cinder-volume[82275]: INFO cinder.volume.manager [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_db.sqlalchemy.engines [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82275) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:26:55 devstack cinder-volume[82275]: INFO oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Starting 1 workers
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Started child 82395 {{(pid=82275) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Full set of CONF: {{(pid=82275) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] ******************************************************************************** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Configuration options gathered from: {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] ================================================================================ {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] allow_availability_zone_fallback = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] allow_compression_on_image_upload = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] allowed_direct_url_schemes     = [] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] api_rate_limit                 = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] auth_strategy                  = keystone {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82395]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_availability_zone      = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_host                   = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_name                   = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_stats_polling_interval = 60 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backup_api_class               = cinder.backup.api.API {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backup_name_template           = backup-%s {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backup_use_same_host           = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backup_use_temp_snapshot       = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] chap_password                  = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] chap_username                  =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cinder_internal_tenant_project_id = 6498b43de06140a59b09d14574fcff4b {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cinder_internal_tenant_user_id = d76fbc826b4f4a6a9bc326848ef24da4 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cluster                        = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] compression_format             = gzip {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] config_dir                     = [] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] config_source                  = [] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] control_exchange               = openstack {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] debug                          = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] default_availability_zone      = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] default_group_type             = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] default_volume_type            = QuobyteHD {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] disk_geometry                  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] driver_client_cert             = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] driver_client_cert_key         = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] driver_data_namespace          = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] driver_ssl_cert_path           = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] driver_ssl_cert_verify         = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] driver_use_ssl                 = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] enable_new_services            = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] enable_unsupported_driver      = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] enforce_multipath_for_image_xfer = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] filter_function                = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance_api_insecure            = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance_api_servers             = ['http://192.168.122.95/image'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance_api_ssl_compression     = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance_ca_certificates_file    = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance_certfile                = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance_keyfile                 = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance_num_retries             = 3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance_request_timeout         = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] goodness_function              = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] graceful_shutdown_timeout      = 5 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] group_api_class                = cinder.group.api.API {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] host                           = devstack {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] image_compress_on_upload       = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] image_conversion_address_space_limit = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] image_conversion_cpu_limit     = 60 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] image_conversion_disable       = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] image_upload_use_cinder_backend = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] image_upload_use_internal_tenant = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] image_volume_cache_enabled     = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] image_volume_cache_max_count   = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] image_volume_cache_max_size_gb = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] init_host_max_objects_retrieval = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] iscsi_target_flags             =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] iscsi_write_cache              = on {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] iser_helper                    = tgtadm {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] iser_ip_address                = 192.168.122.95 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] iser_port                      = 3260 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] log_color                      = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] log_config_append              = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] log_dir                        = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] log_file                       = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] log_options                    = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] log_rotate_interval            = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] log_rotate_interval_type       = days {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] log_rotation_type              = none {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] max_age                        = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] max_logfile_count              = 30 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] max_logfile_size_mb            = 200 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] max_over_subscription_ratio    = 20.0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] message_reap_interval          = 86400 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] message_ttl                    = 2592000 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] migration_create_volume_timeout_secs = 300 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] monkey_patch                   = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] monkey_patch_modules           = [] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] my_ip                          = 192.168.122.95 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] no_snapshot_gb_quota           = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] num_iser_scan_tries            = 3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] num_shell_tries                = 3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] num_volume_device_scan_tries   = 3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] nvmeof_conn_info_version       = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] nvmet_ns_id                    = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] nvmet_port_id                  = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] osapi_max_limit                = 1000 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] osapi_volume_ext_list          = [] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] osapi_volume_listen_port       = 8776 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] osapi_volume_use_ssl           = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] osapi_volume_workers           = 2 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] per_volume_size_limit          = -1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] periodic_fuzzy_delay           = 60 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] periodic_interval              = 60 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] public_endpoint                = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] publish_errors                 = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] quota_backup_gigabytes         = 1000 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] quota_backups                  = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] quota_gigabytes                = 1000 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] quota_groups                   = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] quota_snapshots                = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] quota_volumes                  = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] rate_limit_burst               = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] rate_limit_except_level        = CRITICAL {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] rate_limit_interval            = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] reinit_driver_count            = 3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] replication_device             = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] report_discard_supported       = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] report_interval                = 120 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] reservation_clean_interval     = 86400 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] reservation_expire             = 86400 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] reserved_image_namespaces      = [] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] reserved_percentage            = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] rpc_response_timeout           = 120 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] run_external_periodic_tasks    = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] scst_target_driver             = iscsi {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] scst_target_iqn_name           = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] service_down_time              = 720 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] shell_completion               = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] snapshot_name_template         = snapshot-%s {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] split_loggers                  = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] state_path                     = /opt/stack/data/cinder {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82395]: INFO cinder.volume.manager [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] storage_availability_zone      = nova {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] storage_protocol               = iSCSI {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] syslog_log_facility            = LOG_USER {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82395]: DEBUG cinder.volume.drivers.remotefs [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82395) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] target_helper                  = lioadm {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] target_ip_address              = 192.168.122.95 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] target_port                    = 3260 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] target_protocol                = iscsi {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] target_secondary_ip_addresses  = [] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] trace_flags                    = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] transport_url                  = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] until_refresh                  = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] use_chap_auth                  = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] use_default_quota_class        = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] use_journal                    = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] use_json                       = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] use_multipath_for_image_xfer   = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] use_stderr                     = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] use_syslog                     = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] verify_glance_signatures       = enabled {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_api_class               = cinder.volume.api.API {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_backend_name            = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_clear                   = zero {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_clear_ionice            = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_clear_size              = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_copy_bps_limit          = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_dd_blocksize            = 1M {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_name_template           = volume-%s {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_service_inithost_offload = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volume_usage_audit_period      = month {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] zoning_mode                    = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_concurrency.disable_process_locking = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.admin_password = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.admin_token = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.admin_user  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.auth_protocol = https {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.auth_section = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.auth_type   = password {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.auth_uri    = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.auth_version = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.cache       = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.certfile    = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.identity_uri = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.include_service_catalog = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.insecure    = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.interface   = public {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.keyfile     = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_password =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcache_username =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.region_name = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.service_type = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.backend                  = dogpile.cache.null {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.backend_argument         = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.backend_expiration_time  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.config_prefix            = cache.oslo {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.debug_cache_backend      = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.enable_retry_client      = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.enable_socket_keepalive  = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.enabled                  = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.enforce_fips_mode        = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.expiration_time          = 600 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.hashclient_retry_attempts = 2 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.memcache_dead_retry      = 300 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.memcache_sasl_enabled    = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.password                 = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.proxies                  = [] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.redis_db                 = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.redis_server             = localhost:6379 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.retry_attempts           = 2 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.retry_delay              = 0.0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.socket_keepalive_count   = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.socket_keepalive_idle    = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.socket_keepalive_interval = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.socket_timeout           = 1.0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.tls_allowed_ciphers      = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.tls_cafile               = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.tls_certfile             = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.tls_enabled              = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.tls_keyfile              = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cache.username                 = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] coordination.backend_url       = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.asyncio_connection    = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.asyncio_slave_connection = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.backend               = sqlalchemy {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.connection            = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.connection_debug      = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.connection_parameters =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.connection_recycle_time = 3600 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.connection_trace      = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.db_inc_retry_interval = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.db_max_retries        = 20 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.db_max_retry_interval = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.db_retry_interval     = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.max_overflow          = 50 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.max_pool_size         = 5 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.max_retries           = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.mysql_wsrep_sync_wait = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.pool_timeout          = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.retry_interval        = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.slave_connection      = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.sqlite_synchronous    = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.synchronous_reader    = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] database.use_db_reconnect      = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler.connection_string     = messaging:// {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler.enabled               = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler.es_doc_type           = notification {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler.es_scroll_size        = 10000 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler.es_scroll_time        = 2m {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler.filter_error_trace    = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler.hmac_keys             = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler.sentinel_service_name = mymaster {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler.socket_timeout        = 0.1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler.trace_requests        = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler.trace_sqlalchemy      = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler_jaeger.process_tags   = {} {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler_jaeger.service_name_prefix = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] profiler_otlp.service_name_prefix = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_policy.enforce_new_defaults = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: WARNING oslo_config.cfg [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_policy.enforce_scope      = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_policy.policy_default_rule = default {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] privsep_osbrick.group          = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] privsep_osbrick.helper_command = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] privsep_osbrick.user           = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cinder_sys_admin.group         = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cinder_sys_admin.helper_command = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] cinder_sys_admin.user          = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] service_user.auth_section      = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] service_user.auth_type         = password {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] service_user.cafile            = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] service_user.certfile          = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] service_user.collect_timing    = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] service_user.insecure          = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] service_user.keyfile           = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] service_user.send_service_user_token = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] service_user.split_loggers     = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] service_user.timeout           = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance.auth_section            = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance.auth_type               = password {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance.certfile                = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance.collect_timing          = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance.insecure                = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance.keyfile                 = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance.region_name             = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance.split_loggers           = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] glance.timeout                 = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.backend_availability_zone = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.chap_password = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.chap_username =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.disk_geometry = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.driver_client_cert = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.driver_client_cert_key = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.driver_data_namespace = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.driver_use_ssl = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.extra_capabilities = {} {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.filter_function = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.goodness_function = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.iscsi_target_flags =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.iscsi_write_cache = on {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.iser_port     = 3260 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nas_host      =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nas_login     = admin {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nas_mount_options = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nas_password  = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nas_private_key =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nas_share_path =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.num_shell_tries = 3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.quobyte_volume_url = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.replication_device = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82395]: DEBUG cinder.volume.drivers.quobyte [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82395) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.report_discard_supported = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82395]: WARNING cinder.volume.drivers.quobyte [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.reserved_percentage = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82395]: WARNING cinder.volume.drivers.quobyte [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.target_helper = tgtadm {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.target_port   = 3260 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Running cmd (subprocess): mount.quobyte {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.target_protocol = iscsi {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.trace_flags   = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.unique_fqdn_network = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.use_chap_auth = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.volume_backend_name = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.volume_clear  = zero {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.volume_clear_ionice = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.volume_clear_size = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_reports.file_event_handler = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_reports.log_dir           = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.backend_availability_zone = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.backend_host         = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.chap_password        = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.chap_username        = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.disk_geometry        = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.driver_client_cert   = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.driver_data_namespace = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.extra_capabilities   = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.filter_function      = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.goodness_function    = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.iser_helper          = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.iser_ip_address      = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.iser_port            = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nas_host             = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nas_login            = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nas_mount_options    = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nas_password         = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nas_private_key      = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nas_share_path       = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.num_shell_tries      = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.replication_device   = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.report_discard_supported = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.reserved_percentage  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.scst_target_driver   = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.storage_protocol     = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.target_helper        = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.target_ip_address    = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.target_port          = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.target_prefix        = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.target_protocol      = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.trace_flags          = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.use_chap_auth        = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.volume_clear         = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.volume_clear_size    = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] QuobyteHD.volumes_dir          = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_notifications.driver = [] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_notifications.retry = -1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] key_manager.fixed_key          = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.barbican_api_version  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.barbican_endpoint     = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.barbican_endpoint_type = public {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.barbican_region_name  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.cafile                = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.certfile              = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.collect_timing        = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.insecure              = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.keyfile               = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.number_of_retries     = 60 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.retry_delay           = 1 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.send_service_user_token = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.split_loggers         = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.timeout               = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.verify_ssl            = True {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican.verify_ssl_path       = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican_service_user.auth_section = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican_service_user.auth_type = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican_service_user.cafile   = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican_service_user.certfile = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican_service_user.collect_timing = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican_service_user.insecure = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican_service_user.keyfile  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican_service_user.split_loggers = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] barbican_service_user.timeout  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vault.approle_role_id          = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vault.approle_secret_id        = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vault.kv_mountpoint            = secret {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vault.kv_path                  = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vault.kv_version               = 2 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vault.namespace                = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vault.root_token_id            = **** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vault.ssl_ca_crt_file          = None {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vault.timeout                  = 60.0 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vault.use_ssl                  = False {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:26:55 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] ******************************************************************************** {{(pid=82275) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 20:26:55 devstack quobyte-client[82396]: Reading configuration file: /etc/quobyte/client.cfg
Apr 13 20:26:55 devstack quobyte-client[82396]: Invalid parameters found, error: missing mount point.
Apr 13 20:26:55 devstack quobyte-client[82396]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 13 20:26:55 devstack quobyte-client[82396]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 13 20:26:55 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] CMD "mount.quobyte" returned: 1 in 0.089s {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:26:55 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:26:55 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:26:55 devstack cinder-volume[82395]: DEBUG cinder.volume.drivers.quobyte [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82395) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:26:55 devstack cinder-volume[82395]: INFO cinder.volume.drivers.quobyte [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b ...
Apr 13 20:26:55 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 -c /etc/quobyte/client-cinder.cfg {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:26:55 devstack sudo[82397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 -c /etc/quobyte/client-cinder.cfg
Apr 13 20:26:55 devstack sudo[82397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:26:56 devstack sudo[82397]: pam_unix(sudo:session): session closed for user root
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.496s {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:26:56 devstack cinder-volume[82395]: INFO cinder.volume.drivers.quobyte [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b succeeded
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG cinder.volume.drivers.quobyte [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82395) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.520s {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:26:56 devstack sudo[82466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:26:56 devstack sudo[82466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:26:56 devstack sudo[82466]: pam_unix(sudo:session): session closed for user root
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.398s {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:26:56 devstack cinder-volume[82395]: INFO cinder.volume.driver [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG cinder.volume.driver [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82395) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG oslo_db.sqlalchemy.engines [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG dbcounter [-] [82395] Writer thread running {{(pid=82395) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG cinder.db.sqlalchemy.api [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Building query based on filter {{(pid=82395) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG cinder.image.image_utils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82395) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 20:26:56 devstack cinder-volume[82395]: INFO cinder.keymgr.migration [None req-136dd3cb-d4c2-4abd-8188-0ba61d5e7fcd None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG cinder.volume.drivers.quobyte [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82395) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG cinder.volume.drivers.quobyte [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82395) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:26:56 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:26:56 devstack sudo[82469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:26:56 devstack sudo[82469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:26:57 devstack sudo[82469]: pam_unix(sudo:session): session closed for user root
Apr 13 20:26:57 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.421s {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:26:57 devstack cinder-volume[82395]: DEBUG cinder.manager [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Notifying Schedulers of capabilities ... {{(pid=82395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:26:57 devstack cinder-volume[82395]: INFO cinder.volume.manager [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Driver initialization completed successfully.
Apr 13 20:26:57 devstack cinder-volume[82395]: INFO cinder.manager [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Initiating service 3 cleanup
Apr 13 20:26:57 devstack cinder-volume[82395]: INFO cinder.manager [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Service 3 cleanup completed.
Apr 13 20:26:57 devstack cinder-volume[82395]: DEBUG cinder.service [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Creating RPC server for service cinder-volume {{(pid=82395) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 20:26:57 devstack cinder-volume[82395]: DEBUG cinder.service [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82395) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 20:26:57 devstack cinder-volume[82395]: INFO cinder.volume.manager [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 13 20:26:57 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:26:57 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:26:57 devstack cinder-volume[82395]: DEBUG cinder.volume.drivers.quobyte [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82395) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:26:57 devstack cinder-volume[82395]: DEBUG cinder.volume.drivers.quobyte [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82395) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:26:57 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:26:57 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:26:57 devstack sudo[82474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:26:57 devstack sudo[82474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:26:57 devstack sudo[82474]: pam_unix(sudo:session): session closed for user root
Apr 13 20:26:57 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.394s {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:26:57 devstack cinder-volume[82395]: INFO cinder.volume.manager [None req-be05f531-f547-4cd0-a01f-ffe3608ac29e None None] Driver post RPC initialization completed successfully.
Apr 13 20:27:00 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-61a3af3f-bc85-4f94-ae97-18a5fca42d64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:27:00 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-61a3af3f-bc85-4f94-ae97-18a5fca42d64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:27:00 devstack cinder-volume[82395]: DEBUG cinder.volume.drivers.quobyte [None req-61a3af3f-bc85-4f94-ae97-18a5fca42d64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82395) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:27:00 devstack cinder-volume[82395]: DEBUG cinder.volume.drivers.quobyte [None req-61a3af3f-bc85-4f94-ae97-18a5fca42d64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82395) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:27:00 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-61a3af3f-bc85-4f94-ae97-18a5fca42d64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82395) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:27:00 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-61a3af3f-bc85-4f94-ae97-18a5fca42d64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:27:00 devstack sudo[82540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:27:00 devstack sudo[82540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:27:00 devstack sudo[82540]: pam_unix(sudo:session): session closed for user root
Apr 13 20:27:00 devstack cinder-volume[82395]: DEBUG oslo_concurrency.processutils [None req-61a3af3f-bc85-4f94-ae97-18a5fca42d64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.392s {{(pid=82395) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:27:00 devstack cinder-volume[82395]: DEBUG cinder.manager [None req-61a3af3f-bc85-4f94-ae97-18a5fca42d64 None None] Notifying Schedulers of capabilities ... {{(pid=82395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:27:04 devstack cinder-volume[82275]: INFO oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Caught SIGTERM, stopping children
Apr 13 20:27:04 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Acquiring lock "singleton_lock" {{(pid=82275) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 20:27:04 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Acquired lock "singleton_lock" {{(pid=82275) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 20:27:04 devstack cinder-volume[82275]: DEBUG oslo_concurrency.lockutils [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Releasing lock "singleton_lock" {{(pid=82275) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 20:27:04 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Stop services. {{(pid=82275) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 13 20:27:04 devstack cinder-volume[82275]: DEBUG oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Killing children. {{(pid=82275) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 13 20:27:04 devstack cinder-volume[82275]: INFO oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Waiting on 1 children to exit
Apr 13 20:27:05 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Acquiring lock "singleton_lock" {{(pid=82395) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 20:27:05 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Acquired lock "singleton_lock" {{(pid=82395) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 20:27:05 devstack cinder-volume[82395]: DEBUG oslo_concurrency.lockutils [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Releasing lock "singleton_lock" {{(pid=82395) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 20:27:05 devstack cinder-volume[82395]: WARNING amqp [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 20:27:05 devstack cinder-volume[82395]: WARNING amqp [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 20:27:05 devstack cinder-volume[82275]: INFO oslo_service.backend._eventlet.service [None req-6b5cab16-3ba2-40a6-bb63-2ef0cb8a24c0 None None] Child 82395 exited with status 0
Apr 13 20:27:05 devstack cinder-volume[82617]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 20:27:05 devstack cinder-volume[82617]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 20:27:05 devstack cinder-volume[82617]: we strongly recommend against using it for new projects.
Apr 13 20:27:05 devstack cinder-volume[82617]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 20:27:05 devstack cinder-volume[82617]: framework.  For more detail see
Apr 13 20:27:05 devstack cinder-volume[82617]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 20:27:05 devstack cinder-volume[82617]:   import eventlet  # noqa
Apr 13 20:27:07 devstack cinder-volume[82617]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 20:27:07 devstack cinder-volume[82617]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 20:27:07 devstack cinder-volume[82617]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 20:27:08 devstack cinder-volume[82617]: INFO dbcounter [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Registered counter for database cinder
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_db.sqlalchemy.engines [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG dbcounter [-] [82617] Writer thread running {{(pid=82617) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 20:27:08 devstack cinder-volume[82617]: INFO cinder.rpc [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 20:27:08 devstack cinder-volume[82617]: INFO cinder.rpc [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_db.sqlalchemy.engines [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:27:08 devstack cinder-volume[82617]: INFO cinder.volume.manager [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Determined volume DB was empty at startup.
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG cinder.volume.manager [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82617) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 20:27:08 devstack cinder-volume[82617]: WARNING stevedore.named [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 20:27:08 devstack cinder-volume[82617]: WARNING castellan.key_manager [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 20:27:08 devstack cinder-volume[82617]: WARNING cinder.keymgr.conf_key_mgr [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 20:27:08 devstack cinder-volume[82617]: INFO cinder.volume.manager [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_db.sqlalchemy.engines [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:27:08 devstack cinder-volume[82617]: INFO oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Starting 1 workers
Apr 13 20:27:08 devstack cinder-volume[82824]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Started child 82824 {{(pid=82617) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Full set of CONF: {{(pid=82617) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] ******************************************************************************** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Configuration options gathered from: {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] ================================================================================ {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] allow_availability_zone_fallback = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] allow_compression_on_image_upload = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] allowed_direct_url_schemes     = [] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] api_rate_limit                 = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] auth_strategy                  = keystone {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_availability_zone      = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_host                   = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_name                   = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_stats_polling_interval = 60 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backup_api_class               = cinder.backup.api.API {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backup_name_template           = backup-%s {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backup_use_same_host           = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backup_use_temp_snapshot       = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] chap_password                  = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] chap_username                  =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cinder_internal_tenant_project_id = 6498b43de06140a59b09d14574fcff4b {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cinder_internal_tenant_user_id = d76fbc826b4f4a6a9bc326848ef24da4 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cluster                        = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] compression_format             = gzip {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] config_dir                     = [] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] config_source                  = [] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] control_exchange               = openstack {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] debug                          = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] default_availability_zone      = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] default_group_type             = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] default_volume_type            = QuobyteHD {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] disk_geometry                  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] driver_client_cert             = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] driver_client_cert_key         = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] driver_data_namespace          = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] driver_ssl_cert_path           = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] driver_ssl_cert_verify         = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] driver_use_ssl                 = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] enable_new_services            = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] enable_unsupported_driver      = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82824) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] enforce_multipath_for_image_xfer = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] filter_function                = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance_api_insecure            = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance_api_servers             = ['http://192.168.122.95/image'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance_api_ssl_compression     = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance_ca_certificates_file    = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance_certfile                = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance_keyfile                 = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance_num_retries             = 3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance_request_timeout         = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] goodness_function              = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] graceful_shutdown_timeout      = 5 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] group_api_class                = cinder.group.api.API {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] host                           = devstack {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] image_compress_on_upload       = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] image_conversion_address_space_limit = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] image_conversion_cpu_limit     = 60 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] image_conversion_disable       = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] image_upload_use_cinder_backend = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] image_upload_use_internal_tenant = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] image_volume_cache_enabled     = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] image_volume_cache_max_count   = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] image_volume_cache_max_size_gb = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] init_host_max_objects_retrieval = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] iscsi_target_flags             =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] iscsi_write_cache              = on {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] iser_helper                    = tgtadm {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] iser_ip_address                = 192.168.122.95 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] iser_port                      = 3260 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] log_color                      = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] log_config_append              = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] log_dir                        = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] log_file                       = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] log_options                    = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] log_rotate_interval            = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] log_rotate_interval_type       = days {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] log_rotation_type              = none {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] max_age                        = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] max_logfile_count              = 30 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] max_logfile_size_mb            = 200 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] max_over_subscription_ratio    = 20.0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] message_reap_interval          = 86400 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] message_ttl                    = 2592000 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] migration_create_volume_timeout_secs = 300 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] monkey_patch                   = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] monkey_patch_modules           = [] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] my_ip                          = 192.168.122.95 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] no_snapshot_gb_quota           = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] num_iser_scan_tries            = 3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] num_shell_tries                = 3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] num_volume_device_scan_tries   = 3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] nvmeof_conn_info_version       = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] nvmet_ns_id                    = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] nvmet_port_id                  = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] osapi_max_limit                = 1000 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] osapi_volume_ext_list          = [] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] osapi_volume_listen_port       = 8776 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] osapi_volume_use_ssl           = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] osapi_volume_workers           = 2 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] per_volume_size_limit          = -1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] periodic_fuzzy_delay           = 60 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] periodic_interval              = 60 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] public_endpoint                = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] publish_errors                 = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] quota_backup_gigabytes         = 1000 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] quota_backups                  = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] quota_gigabytes                = 1000 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] quota_groups                   = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] quota_snapshots                = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] quota_volumes                  = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] rate_limit_burst               = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] rate_limit_except_level        = CRITICAL {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] rate_limit_interval            = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] reinit_driver_count            = 3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] replication_device             = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] report_discard_supported       = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] report_interval                = 120 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] reservation_clean_interval     = 86400 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] reservation_expire             = 86400 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] reserved_image_namespaces      = [] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] reserved_percentage            = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] rpc_response_timeout           = 120 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] run_external_periodic_tasks    = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] scst_target_driver             = iscsi {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] scst_target_iqn_name           = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] service_down_time              = 720 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] shell_completion               = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] snapshot_name_template         = snapshot-%s {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] split_loggers                  = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] state_path                     = /opt/stack/data/cinder {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82824) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 13 20:27:08 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.quobyte [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 13 20:27:08 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.quobyte [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] storage_availability_zone      = nova {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] storage_protocol               = iSCSI {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Running cmd (subprocess): mount.quobyte {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] syslog_log_facility            = LOG_USER {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] target_helper                  = lioadm {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] target_ip_address              = 192.168.122.95 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] target_port                    = 3260 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] target_protocol                = iscsi {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] target_secondary_ip_addresses  = [] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] trace_flags                    = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] transport_url                  = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] until_refresh                  = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] use_chap_auth                  = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] use_default_quota_class        = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] use_journal                    = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] use_json                       = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] use_multipath_for_image_xfer   = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] use_stderr                     = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] use_syslog                     = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] verify_glance_signatures       = enabled {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_api_class               = cinder.volume.api.API {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_backend_name            = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_clear                   = zero {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_clear_ionice            = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_clear_size              = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_copy_bps_limit          = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_dd_blocksize            = 1M {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_name_template           = volume-%s {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_service_inithost_offload = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volume_usage_audit_period      = month {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] zoning_mode                    = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:08 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_concurrency.disable_process_locking = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.admin_password = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.admin_token = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.admin_user  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.auth_protocol = https {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.auth_section = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.auth_type   = password {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.auth_uri    = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.auth_version = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.cache       = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.certfile    = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.identity_uri = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.include_service_catalog = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.insecure    = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.interface   = public {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.keyfile     = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_password =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack quobyte-client[82839]: Reading configuration file: /etc/quobyte/client.cfg
Apr 13 20:27:09 devstack quobyte-client[82839]: Invalid parameters found, error: missing mount point.
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack quobyte-client[82839]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 13 20:27:09 devstack quobyte-client[82839]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcache_username =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.region_name = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.service_type = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.backend                  = dogpile.cache.null {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.backend_argument         = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.backend_expiration_time  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.config_prefix            = cache.oslo {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.debug_cache_backend      = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.enable_retry_client      = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.enable_socket_keepalive  = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.enabled                  = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.enforce_fips_mode        = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.expiration_time          = 600 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.hashclient_retry_attempts = 2 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.memcache_dead_retry      = 300 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.memcache_sasl_enabled    = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.password                 = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.proxies                  = [] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.redis_db                 = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.redis_server             = localhost:6379 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.retry_attempts           = 2 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.retry_delay              = 0.0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.socket_keepalive_count   = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.socket_keepalive_idle    = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.socket_keepalive_interval = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.socket_timeout           = 1.0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.tls_allowed_ciphers      = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.tls_cafile               = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack sudo[82840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.tls_certfile             = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack sudo[82840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.tls_enabled              = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.tls_keyfile              = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cache.username                 = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] coordination.backend_url       = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.asyncio_connection    = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.asyncio_slave_connection = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.backend               = sqlalchemy {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.connection            = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.connection_debug      = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.connection_parameters =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.connection_recycle_time = 3600 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.connection_trace      = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.db_inc_retry_interval = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.db_max_retries        = 20 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.db_max_retry_interval = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.db_retry_interval     = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.max_overflow          = 50 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.max_pool_size         = 5 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.max_retries           = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.mysql_wsrep_sync_wait = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.pool_timeout          = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.retry_interval        = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.slave_connection      = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.sqlite_synchronous    = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.synchronous_reader    = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] database.use_db_reconnect      = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler.connection_string     = messaging:// {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler.enabled               = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler.es_doc_type           = notification {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler.es_scroll_size        = 10000 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler.es_scroll_time        = 2m {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler.filter_error_trace    = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler.hmac_keys             = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler.sentinel_service_name = mymaster {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler.socket_timeout        = 0.1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler.trace_requests        = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler.trace_sqlalchemy      = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler_jaeger.process_tags   = {} {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler_jaeger.service_name_prefix = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] profiler_otlp.service_name_prefix = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_policy.enforce_new_defaults = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: WARNING oslo_config.cfg [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_policy.enforce_scope      = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_policy.policy_default_rule = default {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] privsep_osbrick.group          = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] privsep_osbrick.helper_command = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] privsep_osbrick.user           = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cinder_sys_admin.group         = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cinder_sys_admin.helper_command = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] cinder_sys_admin.user          = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] service_user.auth_section      = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] service_user.auth_type         = password {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] service_user.cafile            = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] service_user.certfile          = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] service_user.collect_timing    = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] service_user.insecure          = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] service_user.keyfile           = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] service_user.send_service_user_token = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] service_user.split_loggers     = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] service_user.timeout           = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance.auth_section            = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance.auth_type               = password {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance.certfile                = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance.collect_timing          = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance.insecure                = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance.keyfile                 = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance.region_name             = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance.split_loggers           = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] glance.timeout                 = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.backend_availability_zone = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.chap_password = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.chap_username =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.disk_geometry = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.driver_client_cert = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.driver_client_cert_key = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.driver_data_namespace = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.driver_use_ssl = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.extra_capabilities = {} {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.filter_function = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.goodness_function = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.iscsi_target_flags =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.iscsi_write_cache = on {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.iser_port     = 3260 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nas_host      =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nas_login     = admin {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nas_mount_options = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nas_password  = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nas_private_key =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nas_share_path =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.num_shell_tries = 3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.quobyte_volume_url = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.replication_device = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.report_discard_supported = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.reserved_percentage = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.target_helper = tgtadm {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.target_port   = 3260 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.target_protocol = iscsi {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.trace_flags   = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.unique_fqdn_network = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.use_chap_auth = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.volume_backend_name = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.volume_clear  = zero {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.volume_clear_ionice = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.volume_clear_size = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_reports.file_event_handler = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_reports.log_dir           = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.backend_availability_zone = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.backend_host         = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.chap_password        = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.chap_username        = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.disk_geometry        = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.driver_client_cert   = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.driver_data_namespace = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.extra_capabilities   = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.filter_function      = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.goodness_function    = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.iser_helper          = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.iser_ip_address      = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.iser_port            = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nas_host             = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nas_login            = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nas_mount_options    = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nas_password         = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nas_private_key      = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nas_share_path       = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.num_shell_tries      = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.replication_device   = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.report_discard_supported = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.reserved_percentage  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.scst_target_driver   = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.storage_protocol     = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.target_helper        = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.target_ip_address    = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.target_port          = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.target_prefix        = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.target_protocol      = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.trace_flags          = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.use_chap_auth        = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.volume_clear         = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.volume_clear_size    = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] QuobyteHD.volumes_dir          = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_notifications.driver = [] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_notifications.retry = -1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] key_manager.fixed_key          = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.barbican_api_version  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.barbican_endpoint     = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.barbican_endpoint_type = public {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.barbican_region_name  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.cafile                = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.certfile              = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.collect_timing        = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.insecure              = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.keyfile               = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.number_of_retries     = 60 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.retry_delay           = 1 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.send_service_user_token = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.split_loggers         = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.timeout               = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.verify_ssl            = True {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican.verify_ssl_path       = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican_service_user.auth_section = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican_service_user.auth_type = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican_service_user.cafile   = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican_service_user.certfile = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican_service_user.collect_timing = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican_service_user.insecure = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican_service_user.keyfile  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican_service_user.split_loggers = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] barbican_service_user.timeout  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vault.approle_role_id          = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vault.approle_secret_id        = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vault.kv_mountpoint            = secret {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vault.kv_path                  = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vault.kv_version               = 2 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vault.namespace                = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vault.root_token_id            = **** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vault.ssl_ca_crt_file          = None {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vault.timeout                  = 60.0 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vault.use_ssl                  = False {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 20:27:09 devstack cinder-volume[82617]: DEBUG oslo_service.backend._eventlet.service [None req-db6c3031-9048-437d-bf70-a4f1d6594746 None None] ******************************************************************************** {{(pid=82617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 20:27:09 devstack sudo[82840]: pam_unix(sudo:session): session closed for user root
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.512s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:27:09 devstack cinder-volume[82824]: INFO cinder.volume.driver [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG cinder.volume.driver [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82824) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG oslo_db.sqlalchemy.engines [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82824) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writer thread running {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG cinder.db.sqlalchemy.api [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Building query based on filter {{(pid=82824) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82824) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:27:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:27:09 devstack cinder-volume[82824]: INFO cinder.keymgr.migration [None req-62a7ed26-fdc1-48a8-931d-2e686e9dc27f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 20:27:09 devstack sudo[82859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:27:09 devstack sudo[82859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:27:10 devstack sudo[82859]: pam_unix(sudo:session): session closed for user root
Apr 13 20:27:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.468s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:27:10 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:27:10 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Driver initialization completed successfully.
Apr 13 20:27:10 devstack cinder-volume[82824]: INFO cinder.manager [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Initiating service 3 cleanup
Apr 13 20:27:10 devstack cinder-volume[82824]: INFO cinder.manager [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Service 3 cleanup completed.
Apr 13 20:27:10 devstack cinder-volume[82824]: DEBUG cinder.service [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Creating RPC server for service cinder-volume {{(pid=82824) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 20:27:10 devstack cinder-volume[82824]: DEBUG cinder.service [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82824) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 20:27:10 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 13 20:27:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:27:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:27:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:27:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:27:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:27:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:27:10 devstack sudo[82866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:27:10 devstack sudo[82866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:27:10 devstack sudo[82866]: pam_unix(sudo:session): session closed for user root
Apr 13 20:27:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.388s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:27:10 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-24482ca3-9bbd-41a7-9c4c-943a3f5387e2 None None] Driver post RPC initialization completed successfully.
Apr 13 20:27:18 devstack cinder-volume[82617]: DEBUG dbcounter [-] [82617] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82617) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:27:20 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:27:20 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=2 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Flow 'volume_create_manager' (01ce4979-1e9b-4ac7-aa19-cd87f529939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2390f782-3a9c-4536-90af-64cdb51246a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2390f782-3a9c-4536-90af-64cdb51246a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:28:18Z,deleted=False,deleted_at=None,display_description='',display_name='29a65088-4fca-423f-9bab-f3b6247ddb2e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11c634d-04c9-4fa0-9927-9f9f3e891a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3454d5f86b42b8adc72c7b4a9b3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:18Z,use_quota=True,user_id='3fd7a1661e3c44e5bcd46bb662f9a318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ea8727-5da2-450f-a21f-43d55186117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ea8727-5da2-450f-a21f-43d55186117d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2c5aca-7067-4e80-b56a-cda0a7db40ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2c5aca-7067-4e80-b56a-cda0a7db40ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11c634d-04c9-4fa0-9927-9f9f3e891a20', 'volume_name': 'volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329fe33a-e46c-408b-b0f3-91e15ae24681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329fe33a-e46c-408b-b0f3-91e15ae24681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4cc830-2c14-4985-a614-621a16b1a8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:18 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Volume c11c634d-04c9-4fa0-9927-9f9f3e891a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20', 'volume_size': 1}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:28:18Z,deleted=False,deleted_at=None,display_description='',display_name='29a65088-4fca-423f-9bab-f3b6247ddb2e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11c634d-04c9-4fa0-9927-9f9f3e891a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3454d5f86b42b8adc72c7b4a9b3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:18Z,use_quota=True,user_id='3fd7a1661e3c44e5bcd46bb662f9a318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Creating volume c11c634d-04c9-4fa0-9927-9f9f3e891a20 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:28:18 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:28:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:18 devstack sudo[83441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20 1073741824
Apr 13 20:28:18 devstack sudo[83441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Flow 'volume_create_manager' (8d50fb93-7e3a-4ed2-b9eb-55cd012d04a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51333da1-303d-49e8-879e-f8b19b029f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51333da1-303d-49e8-879e-f8b19b029f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1757820380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654f84be-e843-40f2-8bae-075abee21a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa18e3df0224d18a442609825374d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:21Z,use_quota=True,user_id='cbddbaa8283e4a23922e73f687838d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a70e139-49a2-4d4b-996a-0e74c8bb4e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a70e139-49a2-4d4b-996a-0e74c8bb4e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba8ae19-ba59-4d92-90d7-9eaaeb5a4ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba8ae19-ba59-4d92-90d7-9eaaeb5a4ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '654f84be-e843-40f2-8bae-075abee21a8e', 'volume_name': 'volume-654f84be-e843-40f2-8bae-075abee21a8e', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb39900-c90f-4ae1-bbc6-c3006b874ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb39900-c90f-4ae1-bbc6-c3006b874ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc1026-1c6f-4eef-84d7-a11834cd595b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:20 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Volume 654f84be-e843-40f2-8bae-075abee21a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-654f84be-e843-40f2-8bae-075abee21a8e', 'volume_size': 1}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:20 devstack sudo[83441]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20 1073741824" returned: 0 in 1.850s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:20 devstack sudo[83771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20
Apr 13 20:28:20 devstack sudo[83771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:21 devstack sudo[83771]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20" returned: 0 in 0.453s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] <== create_volume: return (2360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.370s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1757820380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654f84be-e843-40f2-8bae-075abee21a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa18e3df0224d18a442609825374d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:21Z,use_quota=True,user_id='cbddbaa8283e4a23922e73f687838d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Creating volume 654f84be-e843-40f2-8bae-075abee21a8e {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:28:21 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4cc830-2c14-4985-a614-621a16b1a8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d2bc6e-c947-48bd-91d0-31d1c72b6d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:21 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Volume volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20 (c11c634d-04c9-4fa0-9927-9f9f3e891a20): created successfully
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d2bc6e-c947-48bd-91d0-31d1c72b6d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:21 devstack sudo[83775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e 1073741824
Apr 13 20:28:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Flow 'volume_create_manager' (01ce4979-1e9b-4ac7-aa19-cd87f529939a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:21 devstack sudo[83775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:21 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-1fb5af88-f987-49fc-b5d2-b188fa6fa5ad tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Created volume successfully.
Apr 13 20:28:22 devstack sudo[83775]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e 1073741824" returned: 0 in 0.864s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:22 devstack sudo[83782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e
Apr 13 20:28:22 devstack sudo[83782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:22 devstack sudo[83782]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e" returned: 0 in 0.590s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:28:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc1026-1c6f-4eef-84d7-a11834cd595b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654f84be-e843-40f2-8bae-075abee21a8e', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f81c0e-7b1a-4570-8429-a8df7ad64da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:22 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Volume volume-654f84be-e843-40f2-8bae-075abee21a8e (654f84be-e843-40f2-8bae-075abee21a8e): created successfully
Apr 13 20:28:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f81c0e-7b1a-4570-8429-a8df7ad64da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Flow 'volume_create_manager' (8d50fb93-7e3a-4ed2-b9eb-55cd012d04a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:22 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c7197063-5e0e-42ee-ae8c-3abe5f3d0354 tempest-VolumesAdminNegativeTest-1887581568 None] Created volume successfully.
Apr 13 20:28:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Acquiring lock "cinder-654f84be-e843-40f2-8bae-075abee21a8e-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:28:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Lock "cinder-654f84be-e843-40f2-8bae-075abee21a8e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:28:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Acquiring lock "cinder-quobyte-654f84be-e843-40f2-8bae-075abee21a8e" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:28:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Lock "cinder-quobyte-654f84be-e843-40f2-8bae-075abee21a8e" acquired by "delete_volume" :: waited 0.019s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:28:24 devstack cinder-volume[82824]: INFO oslo.privsep.daemon [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvf8ptc0j/privsep.sock']
Apr 13 20:28:24 devstack sudo[83791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvf8ptc0j/privsep.sock
Apr 13 20:28:24 devstack sudo[83791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:25 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 13 20:28:25 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 20:28:25 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 13 20:28:25 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 20:28:25 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 13 20:28:25 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 13 20:28:25 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 20:28:25 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 20:28:25 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 13 20:28:26 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 13 20:28:26 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 20:28:26 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 13 20:28:26 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 20:28:26 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 13 20:28:26 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 13 20:28:26 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 20:28:26 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 20:28:26 devstack cinder-volume[82824]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 13 20:28:27 devstack sudo[83791]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:27 devstack cinder-volume[82824]: INFO oslo.privsep.daemon [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Spawned new privsep daemon via rootwrap
Apr 13 20:28:27 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Accepted privsep connection to /tmp/tmpvf8ptc0j/privsep.sock {{(pid=82824) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 13 20:28:27 devstack cinder-volume[82824]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 20:28:27 devstack cinder-volume[82824]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 20:28:27 devstack cinder-volume[82824]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 13 20:28:27 devstack cinder-volume[82824]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83797
Apr 13 20:28:27 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[99be1b6b-0751-4109-8805-e7f8237f266a]: (2,) {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:28:27 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6253f2ce-711c-4cf7-826b-6be75a2bd9c0]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:28:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:27 devstack sudo[83810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e
Apr 13 20:28:27 devstack sudo[83810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:28 devstack cinder-volume[82824]: WARNING py.warnings [req-34dc93f7-7736-419c-b633-1556bfa932cb req-89a6e7ae-7189-4667-97a6-6af1cb4015d2 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 13 20:28:28 devstack cinder-volume[82824]:   .first()
Apr 13 20:28:28 devstack cinder-volume[82824]: 
Apr 13 20:28:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-89a6e7ae-7189-4667-97a6-6af1cb4015d2 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-89a6e7ae-7189-4667-97a6-6af1cb4015d2 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:28 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[226fdb8b-efa6-4ea3-be2e-ce0655de9e7f]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:28:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-89a6e7ae-7189-4667-97a6-6af1cb4015d2 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:28 devstack sudo[83834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20
Apr 13 20:28:28 devstack sudo[83834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:28 devstack sudo[83810]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e" returned: 0 in 1.521s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:28 devstack sudo[83836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e
Apr 13 20:28:28 devstack sudo[83836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:30 devstack sudo[83836]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-654f84be-e843-40f2-8bae-075abee21a8e" returned: 0 in 1.266s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Lock "cinder-quobyte-654f84be-e843-40f2-8bae-075abee21a8e" released by "delete_volume" :: held 5.587s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:28:30 devstack sudo[83834]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-89a6e7ae-7189-4667-97a6-6af1cb4015d2 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20" returned: 0 in 1.627s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-34dc93f7-7736-419c-b633-1556bfa932cb req-89a6e7ae-7189-4667-97a6-6af1cb4015d2 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.650s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:30 devstack cinder-volume[82824]: WARNING cinder.quota [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:28:30 devstack cinder-volume[82824]: WARNING cinder.quota [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-89a6e7ae-7189-4667-97a6-6af1cb4015d2 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b', 'name': 'volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03fd80bd-703c-4dbb-a39b-bfee967001a1', 'enforce_multipath': True} {{(pid=82824) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Created reservations ['c0012ac8-89ca-41a3-bac5-ab5bab6f67d6', '25ee5538-c6d7-4d7d-9c0a-150878fe8b85', '797f8d2d-fa78-4744-9e12-c6c0424517eb', 'aa76db33-bcf6-4838-a480-fb1ae6e79ddd'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:28:30 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-34dc93f7-7736-419c-b633-1556bfa932cb req-89a6e7ae-7189-4667-97a6-6af1cb4015d2 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] attachment_update completed successfully.
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:30 devstack sudo[83861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:28:30 devstack sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:31 devstack sudo[83861]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.635s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:31 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:28:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Deleted volume successfully.
Apr 13 20:28:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-12728519-f98f-4408-b261-3de3cae1101e tempest-VolumesAdminNegativeTest-1887581568 None] Lock "cinder-654f84be-e843-40f2-8bae-075abee21a8e-delete_volume" released by "delete_volume" :: held 6.732s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Flow 'volume_create_manager' (a7c6a9ef-12ca-4b79-89da-2fca9edfa9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a14b103-4d5c-4010-8236-afe60366af8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a14b103-4d5c-4010-8236-afe60366af8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1197773710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c889acbe624989af8203405263ecd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:38Z,use_quota=True,user_id='bc6e1f86bbb64eaaa6475e4de5b81d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa6212f-eb45-41f1-91d4-ee6265281fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa6212f-eb45-41f1-91d4-ee6265281fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9d869a-af7a-48a8-ad14-14a2ec63dade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9d869a-af7a-48a8-ad14-14a2ec63dade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850', 'volume_name': 'volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c01d739-94c6-4e5f-85d8-2f77321d7a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c01d739-94c6-4e5f-85d8-2f77321d7a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b85610-c6fc-4562-b79c-1edba4f2fb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:38 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Volume fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850', 'volume_size': 1}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1197773710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c889acbe624989af8203405263ecd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:38Z,use_quota=True,user_id='bc6e1f86bbb64eaaa6475e4de5b81d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Creating volume fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:28:38 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:28:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:38 devstack sudo[84401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850 1073741824
Apr 13 20:28:38 devstack sudo[84401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:39 devstack sudo[84401]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850 1073741824" returned: 0 in 0.967s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:39 devstack sudo[84409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850
Apr 13 20:28:39 devstack sudo[84409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:40 devstack sudo[84409]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850" returned: 0 in 0.657s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:28:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b85610-c6fc-4562-b79c-1edba4f2fb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7395cad-c298-488b-acdb-2c4c60bce7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:40 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Volume volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850 (fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850): created successfully
Apr 13 20:28:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7395cad-c298-488b-acdb-2c4c60bce7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Flow 'volume_create_manager' (a7c6a9ef-12ca-4b79-89da-2fca9edfa9ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:40 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1994b20b-9d35-4ec2-b271-b87157419a97 tempest-DeleteServersTestJSON-1335291376 None] Created volume successfully.
Apr 13 20:28:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-e9a681e2-b705-42d5-b59c-0c34248897e8 req-9827cd2d-812c-4547-a1fd-01c7a40e6d40 tempest-DeleteServersTestJSON-1335291376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-e9a681e2-b705-42d5-b59c-0c34248897e8 req-9827cd2d-812c-4547-a1fd-01c7a40e6d40 tempest-DeleteServersTestJSON-1335291376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:44 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35c4dbe-d6c1-457b-9958-f234a5dfacad]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:28:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-e9a681e2-b705-42d5-b59c-0c34248897e8 req-9827cd2d-812c-4547-a1fd-01c7a40e6d40 tempest-DeleteServersTestJSON-1335291376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:44 devstack sudo[84468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850
Apr 13 20:28:44 devstack sudo[84468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:45 devstack sudo[84468]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-e9a681e2-b705-42d5-b59c-0c34248897e8 req-9827cd2d-812c-4547-a1fd-01c7a40e6d40 tempest-DeleteServersTestJSON-1335291376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850" returned: 0 in 1.072s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-e9a681e2-b705-42d5-b59c-0c34248897e8 req-9827cd2d-812c-4547-a1fd-01c7a40e6d40 tempest-DeleteServersTestJSON-1335291376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.123s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-e9a681e2-b705-42d5-b59c-0c34248897e8 req-9827cd2d-812c-4547-a1fd-01c7a40e6d40 tempest-DeleteServersTestJSON-1335291376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b', 'name': 'volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '169e4d60-a80b-4d07-9465-3f27956f7af2', 'enforce_multipath': True} {{(pid=82824) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 20:28:45 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-e9a681e2-b705-42d5-b59c-0c34248897e8 req-9827cd2d-812c-4547-a1fd-01c7a40e6d40 tempest-DeleteServersTestJSON-1335291376 None] attachment_update completed successfully.
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Flow 'volume_create_manager' (27804c8d-2b4a-4eba-970c-57e7e6b6eae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2145f5c-2d61-4f0a-92c7-244581e8fc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2145f5c-2d61-4f0a-92c7-244581e8fc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1169603758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a1255f-27ed-45a3-849f-4ba30b6bc12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ba8b6bcad246ca87683a34b78f56d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:51Z,use_quota=True,user_id='72cdddb05f884270867c99f157b4071a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be96be20-605c-4502-ae48-6a207a53568a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be96be20-605c-4502-ae48-6a207a53568a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6bca9e-f33e-443f-b941-8a21376009f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6bca9e-f33e-443f-b941-8a21376009f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a1255f-27ed-45a3-849f-4ba30b6bc12b', 'volume_name': 'volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09da1e4e-458a-4204-9d5c-cacc5c8b6a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09da1e4e-458a-4204-9d5c-cacc5c8b6a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe3d6ec-214c-499b-87b4-e26e0f1d4037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:50 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Volume 18a1255f-27ed-45a3-849f-4ba30b6bc12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b', 'volume_size': 1}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1169603758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a1255f-27ed-45a3-849f-4ba30b6bc12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ba8b6bcad246ca87683a34b78f56d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:51Z,use_quota=True,user_id='72cdddb05f884270867c99f157b4071a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Creating volume 18a1255f-27ed-45a3-849f-4ba30b6bc12b {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:28:50 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:28:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:50 devstack sudo[84541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b 1073741824
Apr 13 20:28:50 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:51 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b 1073741824" returned: 0 in 0.893s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:51 devstack sudo[84548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b
Apr 13 20:28:51 devstack sudo[84548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:52 devstack sudo[84548]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b" returned: 0 in 0.693s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:28:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe3d6ec-214c-499b-87b4-e26e0f1d4037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23509029-d851-43e8-b629-dcbc5d2dac5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:52 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Volume volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b (18a1255f-27ed-45a3-849f-4ba30b6bc12b): created successfully
Apr 13 20:28:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23509029-d851-43e8-b629-dcbc5d2dac5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Flow 'volume_create_manager' (27804c8d-2b4a-4eba-970c-57e7e6b6eae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:52 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5f95ff3b-8793-4a2a-9006-dc6641383106 tempest-ServersNegativeTestJSON-1615890815 None] Created volume successfully.
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Flow 'volume_create_manager' (72f1ba03-f040-47de-bdb4-11aa1df56025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9097d197-c101-4f5e-89dd-83a18b0c29b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9097d197-c101-4f5e-89dd-83a18b0c29b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-909873118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1bfec8-a445-4b07-b202-aba53e2c1717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ba8b6bcad246ca87683a34b78f56d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:54Z,use_quota=True,user_id='72cdddb05f884270867c99f157b4071a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccdf7b6-880c-4af0-b06d-149857680d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccdf7b6-880c-4af0-b06d-149857680d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6b019c-d59e-408f-ad3e-deb6eb776957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6b019c-d59e-408f-ad3e-deb6eb776957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1bfec8-a445-4b07-b202-aba53e2c1717', 'volume_name': 'volume-bb1bfec8-a445-4b07-b202-aba53e2c1717', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de93e7a-ab0f-4e0b-93dd-4b03c578550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de93e7a-ab0f-4e0b-93dd-4b03c578550e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa75348-f779-453c-b78d-81edf19b708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:54 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Volume bb1bfec8-a445-4b07-b202-aba53e2c1717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1bfec8-a445-4b07-b202-aba53e2c1717', 'volume_size': 1}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-909873118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1bfec8-a445-4b07-b202-aba53e2c1717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ba8b6bcad246ca87683a34b78f56d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:54Z,use_quota=True,user_id='72cdddb05f884270867c99f157b4071a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Creating volume bb1bfec8-a445-4b07-b202-aba53e2c1717 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:28:54 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:54 devstack sudo[84637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717 1073741824
Apr 13 20:28:54 devstack sudo[84637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:54 devstack sudo[84637]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717 1073741824" returned: 0 in 0.780s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:54 devstack sudo[84644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717
Apr 13 20:28:54 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:55 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-f4bc5001-d20c-4f4a-8782-63ddec3326ef req-c4ec7eb9-32ef-4ca6-920c-a7a91eefea7c tempest-DeleteServersTestJSON-1335291376 None] Terminate volume connection completed successfully.
Apr 13 20:28:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-f4bc5001-d20c-4f4a-8782-63ddec3326ef req-c4ec7eb9-32ef-4ca6-920c-a7a91eefea7c tempest-DeleteServersTestJSON-1335291376 None] Deleting attachment 169e4d60-a80b-4d07-9465-3f27956f7af2. {{(pid=82824) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 20:28:55 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717" returned: 0 in 0.690s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:28:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa75348-f779-453c-b78d-81edf19b708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1bfec8-a445-4b07-b202-aba53e2c1717', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a7e399-a320-4177-97fc-902d83cae622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:55 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Volume volume-bb1bfec8-a445-4b07-b202-aba53e2c1717 (bb1bfec8-a445-4b07-b202-aba53e2c1717): created successfully
Apr 13 20:28:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a7e399-a320-4177-97fc-902d83cae622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Flow 'volume_create_manager' (72f1ba03-f040-47de-bdb4-11aa1df56025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:55 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b1d87045-3ee2-4932-868c-3a7599e8f540 tempest-ServersNegativeTestJSON-1615890815 None] Created volume successfully.
Apr 13 20:28:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Acquiring lock "cinder-bb1bfec8-a445-4b07-b202-aba53e2c1717-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:28:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Lock "cinder-bb1bfec8-a445-4b07-b202-aba53e2c1717-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:28:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Acquiring lock "cinder-quobyte-bb1bfec8-a445-4b07-b202-aba53e2c1717" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:28:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Lock "cinder-quobyte-bb1bfec8-a445-4b07-b202-aba53e2c1717" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:28:56 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cc017d-dd6c-4642-8bb1-de3053fe7dbb]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:28:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:56 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f13fa099-3dba-49e9-95ad-b964f0da42d2 tempest-GroupSnapshotsTest-1575066988 None] Group tempest-GroupSnapshotsTest-Group-1683072700: creating
Apr 13 20:28:56 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f13fa099-3dba-49e9-95ad-b964f0da42d2 tempest-GroupSnapshotsTest-1575066988 None] Group tempest-GroupSnapshotsTest-Group-1683072700: created successfully
Apr 13 20:28:56 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f13fa099-3dba-49e9-95ad-b964f0da42d2 tempest-GroupSnapshotsTest-1575066988 None] Create group completed successfully.
Apr 13 20:28:56 devstack sudo[84653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717
Apr 13 20:28:56 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:57 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717" returned: 0 in 0.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:57 devstack sudo[84658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717
Apr 13 20:28:57 devstack sudo[84658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:57 devstack sudo[84658]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_service.periodic_task [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82824) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bb1bfec8-a445-4b07-b202-aba53e2c1717" returned: 0 in 0.449s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Lock "cinder-quobyte-bb1bfec8-a445-4b07-b202-aba53e2c1717" released by "delete_volume" :: held 1.000s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:28:57 devstack sudo[84661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:28:57 devstack sudo[84661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Created reservations ['38273a43-e14a-40d0-9371-a050c0fda0eb', '9cb32d5d-c18e-4a01-b623-1c19201e1c87', 'dd3994d8-d2a5-4328-9b96-ec3c27ee28d4', '841a0f9b-7305-4b9f-9720-362f2f5c35a8'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:57 devstack sudo[84663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:28:57 devstack sudo[84663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Acquiring lock "cinder-18a1255f-27ed-45a3-849f-4ba30b6bc12b-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Lock "cinder-18a1255f-27ed-45a3-849f-4ba30b6bc12b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Acquiring lock "cinder-quobyte-18a1255f-27ed-45a3-849f-4ba30b6bc12b" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Lock "cinder-quobyte-18a1255f-27ed-45a3-849f-4ba30b6bc12b" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ac79e7-66ac-4d89-9428-2dfbefe5d3ff]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:28:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:57 devstack sudo[84665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b
Apr 13 20:28:57 devstack sudo[84665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:58 devstack sudo[84661]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.554s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Flow 'volume_create_manager' (d69f8942-0b74-4835-bffb-98a3e965b030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099521c3-658a-4aee-8ed3-25e30947391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099521c3-658a-4aee-8ed3-25e30947391e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-934414623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c393b4ba-acfe-4e0b-b088-3bb62899c305,host='devstack@QuobyteHD#QuobyteHD',id=0214e324-d0f9-474c-ad9b-62b67b4e7b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7832cdd1637472d9de4e4b2c989d1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:58Z,use_quota=True,user_id='6b0e74bffcd5463da53d2fd1193b497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82b46fc-ca82-4afd-a465-a0b217b9c832),volume_type_id=c82b46fc-ca82-4afd-a465-a0b217b9c832)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec53b046-0d4f-4212-9c35-ecedf6522645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec53b046-0d4f-4212-9c35-ecedf6522645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809fa8b8-6900-43ab-95da-83534d72e5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809fa8b8-6900-43ab-95da-83534d72e5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0214e324-d0f9-474c-ad9b-62b67b4e7b43', 'volume_name': 'volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df1dae7-dac6-45cf-b239-3a897ba83e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df1dae7-dac6-45cf-b239-3a897ba83e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3a1c83-61e9-4b9a-bf7a-47297cdf377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:58 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Volume 0214e324-d0f9-474c-ad9b-62b67b4e7b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43', 'volume_size': 1}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c393b4ba-acfe-4e0b-b088-3bb62899c305,created_at=2026-04-13T18:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-934414623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c393b4ba-acfe-4e0b-b088-3bb62899c305,host='devstack@QuobyteHD#QuobyteHD',id=0214e324-d0f9-474c-ad9b-62b67b4e7b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7832cdd1637472d9de4e4b2c989d1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:28:58Z,use_quota=True,user_id='6b0e74bffcd5463da53d2fd1193b497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82b46fc-ca82-4afd-a465-a0b217b9c832),volume_type_id=c82b46fc-ca82-4afd-a465-a0b217b9c832)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Creating volume 0214e324-d0f9-474c-ad9b-62b67b4e7b43 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:28:58 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:58 devstack sudo[84669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 1073741824
Apr 13 20:28:58 devstack sudo[84669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:58 devstack sudo[84663]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.569s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:28:58 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Deleted volume successfully.
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7abfdb2c-f13d-460e-9123-cbb1a0355942 tempest-ServersNegativeTestJSON-1615890815 None] Lock "cinder-bb1bfec8-a445-4b07-b202-aba53e2c1717-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:28:58 devstack sudo[84665]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b" returned: 0 in 0.549s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:58 devstack sudo[84674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b
Apr 13 20:28:58 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:58 devstack sudo[84669]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 1073741824" returned: 0 in 0.546s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:58 devstack sudo[84680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43
Apr 13 20:28:58 devstack sudo[84680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:58 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-18a1255f-27ed-45a3-849f-4ba30b6bc12b" returned: 0 in 0.520s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Acquiring lock "cinder-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Lock "cinder-quobyte-18a1255f-27ed-45a3-849f-4ba30b6bc12b" released by "delete_volume" :: held 1.120s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Lock "cinder-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Acquiring lock "cinder-quobyte-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:28:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Lock "cinder-quobyte-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850" acquired by "delete_volume" :: waited 0.024s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba0db38-ef96-4bce-8a52-0781373d7dc3]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Created reservations ['b3786d5d-c08e-46f0-8f74-c4cb40045b63', '41fe932c-d189-46dd-b3b1-6fe250052393', '65e2f3a5-6d35-4857-a5df-c092f0ebd9e2', 'ba968da2-7f8e-4a89-8d21-56e69520b428'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:59 devstack sudo[84683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:28:59 devstack sudo[84682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850
Apr 13 20:28:59 devstack sudo[84682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:59 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:59 devstack sudo[84680]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43" returned: 0 in 0.480s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3a1c83-61e9-4b9a-bf7a-47297cdf377f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c039acc-d335-41f2-aba8-7ea77b0ab8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:28:59 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Volume volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 (0214e324-d0f9-474c-ad9b-62b67b4e7b43): created successfully
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c039acc-d335-41f2-aba8-7ea77b0ab8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Flow 'volume_create_manager' (d69f8942-0b74-4835-bffb-98a3e965b030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:28:59 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-32a7a14e-a4b2-4b6c-a017-abfd8321c0c0 tempest-GroupSnapshotsTest-1575066988 None] Created volume successfully.
Apr 13 20:28:59 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.456s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:28:59 devstack sudo[84682]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850" returned: 0 in 0.521s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:59 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Deleted volume successfully.
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:28:59 devstack sudo[84693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850
Apr 13 20:28:59 devstack sudo[84693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b6436f3a-626e-494b-80f2-a035fbba73a8 tempest-ServersNegativeTestJSON-1615890815 None] Lock "cinder-18a1255f-27ed-45a3-849f-4ba30b6bc12b-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:28:59 devstack sudo[84693]: pam_unix(sudo:session): session closed for user root
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850" returned: 0 in 0.450s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:28:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Lock "cinder-quobyte-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850" released by "delete_volume" :: held 0.999s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Created reservations ['22355e08-0aaa-437d-9993-2bd32e82b1d5', '67023193-ee57-4afd-9c6a-c882b56c3c62', 'b0a6913b-eb4a-48f6-bb55-df9415421fdd', '92a24cb4-93fd-46fe-b9c2-b5da9440ee99'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:00 devstack sudo[84697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:29:00 devstack sudo[84697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:00 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] GroupSnapshot 744f2262-a650-41dd-9403-5d7557dd7941: creating.
Apr 13 20:29:00 devstack sudo[84697]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.446s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:29:00 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Deleted volume successfully.
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] Group snapshot 744f2262-a650-41dd-9403-5d7557dd7941: creating. {{(pid=82824) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] Creating offline snapshot bd403ad1-7d25-4d81-b767-205b4c789f92 of volume 0214e324-d0f9-474c-ad9b-62b67b4e7b43 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2fad7e81-b19e-4a29-bd49-e9d0afe430eb tempest-DeleteServersTestJSON-1335291376 None] Lock "cinder-fa3b7fec-6bea-4d9a-b9b1-bfbaf9645850-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c0a7ca-2bc4-485c-89ad-c7152db0af0b]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:00 devstack sudo[84701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43
Apr 13 20:29:00 devstack sudo[84701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:01 devstack sudo[84701]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43" returned: 0 in 0.568s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:01 devstack sudo[84716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92 1G
Apr 13 20:29:01 devstack sudo[84716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:01 devstack sudo[84716]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92 1G" returned: 0 in 0.602s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:01 devstack sudo[84743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92
Apr 13 20:29:01 devstack sudo[84743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:02 devstack sudo[84743]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92" returned: 0 in 0.581s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:02 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:29:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:02 devstack sudo[84753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92
Apr 13 20:29:02 devstack sudo[84753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:02 devstack sudo[84753]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92" returned: 0 in 0.534s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:02 devstack sudo[84772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.info
Apr 13 20:29:02 devstack sudo[84772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:03 devstack sudo[84772]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.info" returned: 0 in 0.507s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:03 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:29:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:03 devstack sudo[84778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.info
Apr 13 20:29:03 devstack sudo[84778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:03 devstack sudo[84778]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.info" returned: 0 in 0.510s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.363s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:04 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2fc44095-e243-4592-b33e-a8a649bf9c53 tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 744f2262-a650-41dd-9403-5d7557dd7941: created successfully
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-bd403ad1-7d25-4d81-b767-205b4c789f92-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" by "_create_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-bd403ad1-7d25-4d81-b767-205b4c789f92-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Creating volume 78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5 from snapshot bd403ad1-7d25-4d81-b767-205b4c789f92 {{(pid=82824) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] snapshot: bd403ad1-7d25-4d81-b767-205b4c789f92, volume: 78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcef69c-98f6-4ae7-90ac-e78b0f7309b6]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:06 devstack sudo[84790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92
Apr 13 20:29:06 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:06 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92" returned: 0 in 0.609s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:29:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:29:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:29:06 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2ff04c-e38b-4c97-849d-4003788c4841]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:06 devstack sudo[84826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43
Apr 13 20:29:06 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:07 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43" returned: 0 in 0.787s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:07 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5 not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:29:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:07 devstack sudo[84835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5
Apr 13 20:29:07 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:10 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" returned: 0 in 3.027s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:10 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efa036c-a3e5-490b-8113-2847660b7af5]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:10 devstack sudo[84870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43
Apr 13 20:29:10 devstack sudo[84870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:10 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:UPDATE=67,cinder:SELECT=51,cinder:INSERT=15,cinder:DELETE=5 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:29:11 devstack sudo[84870]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43" returned: 0 in 0.778s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:11 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43, size 1024.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5 {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:29:11 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Converted 1024.00 MB image at 338.18 MB/s
Apr 13 20:29:11 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:29:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:11 devstack sudo[84875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5
Apr 13 20:29:11 devstack sudo[84875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:11 devstack sudo[84875]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" returned: 0 in 0.480s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" released by "_copy_volume_from_snapshot" :: held 5.790s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-bd403ad1-7d25-4d81-b767-205b4c789f92-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" released by "_create_volume_from_snapshot" :: held 5.824s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.836s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:11 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=58,cinder:UPDATE=47,cinder:INSERT=8,cinder:DELETE=5 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:29:11 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-df6b8d2d-0ef0-4cbb-8b00-bc52197397c3 tempest-GroupSnapshotsTest-1575066988 None] Create group from source-snapshot-744f2262-a650-41dd-9403-5d7557dd7941 completed successfully.
Apr 13 20:29:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:12 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebfc9e4-7aae-4ddb-a468-0902a112199f]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:12 devstack sudo[84880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5
Apr 13 20:29:12 devstack sudo[84880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:13 devstack sudo[84880]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" returned: 0 in 1.021s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:13 devstack sudo[84895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5
Apr 13 20:29:13 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:14 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" returned: 0 in 1.068s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-78989f6d-d6d7-47d7-b5db-70bf9fb3dcc5" released by "delete_volume" :: held 2.126s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:14 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['26f48e86-2791-4859-9695-4fd82e458ed7'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:14 devstack cinder-volume[82824]: WARNING cinder.quota [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1890242575 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1890242575, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:29:14 devstack cinder-volume[82824]: WARNING cinder.quota [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1890242575 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1890242575, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:29:14 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['e3a0d52e-f57a-4272-bce7-48f6c9737328', '1378a32b-6cda-4bca-b354-d18e70a6ca70', '5a78df0e-c316-4f8d-8f2a-c717d5ee36eb', '559f2347-bd60-49ea-87af-ff319a80890e'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:15 devstack sudo[84942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:29:15 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:15 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.767s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:15 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:29:15 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-14c3b890-ba35-4654-af50-513b1f2975d4 tempest-GroupSnapshotsTest-1575066988 None] Delete group completed successfully.
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Flow 'volume_create_manager' (b7b39c3b-b26e-4bf5-9c42-6abe29d0dd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc034fc-e1a9-49ab-a461-68520d3d0f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc034fc-e1a9-49ab-a461-68520d3d0f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1258342194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65edfdc5-0b76-4939-9241-6adfa4a0d525,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7898edd3eab64f41847c7653c5df06d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:16Z,use_quota=True,user_id='c0911fe8e4504914aefa91d00f7035eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2a5e60-6e1c-4d39-bb97-8fb83b68a602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2a5e60-6e1c-4d39-bb97-8fb83b68a602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbdf43c-8778-4877-a0a4-54b409aba939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbdf43c-8778-4877-a0a4-54b409aba939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65edfdc5-0b76-4939-9241-6adfa4a0d525', 'volume_name': 'volume-65edfdc5-0b76-4939-9241-6adfa4a0d525', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837634e9-c874-4614-b348-9acfeff727e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837634e9-c874-4614-b348-9acfeff727e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f79ab85-e5de-47fa-b500-80bf26977e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:16 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Volume 65edfdc5-0b76-4939-9241-6adfa4a0d525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65edfdc5-0b76-4939-9241-6adfa4a0d525', 'volume_size': 1}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1258342194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65edfdc5-0b76-4939-9241-6adfa4a0d525,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7898edd3eab64f41847c7653c5df06d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:16Z,use_quota=True,user_id='c0911fe8e4504914aefa91d00f7035eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Creating volume 65edfdc5-0b76-4939-9241-6adfa4a0d525 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:29:16 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:16 devstack sudo[84947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525 1073741824
Apr 13 20:29:16 devstack sudo[84947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:16 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 744f2262-a650-41dd-9403-5d7557dd7941: deleting
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 744f2262-a650-41dd-9403-5d7557dd7941: deleting {{(pid=82824) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-0214e324-d0f9-474c-ad9b-62b67b4e7b43" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-0214e324-d0f9-474c-ad9b-62b67b4e7b43" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-bd403ad1-7d25-4d81-b767-205b4c789f92" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-bd403ad1-7d25-4d81-b767-205b4c789f92" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Deleting offline snapshot bd403ad1-7d25-4d81-b767-205b4c789f92 of volume 0214e324-d0f9-474c-ad9b-62b67b4e7b43 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] snapshot_file for this snap is: volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[290b547b-c9d4-4fa5-8d2d-84a878ce4f9e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:16 devstack sudo[84949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92
Apr 13 20:29:16 devstack sudo[84949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:16 devstack sudo[84947]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525 1073741824" returned: 0 in 0.849s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:17 devstack sudo[84957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525
Apr 13 20:29:17 devstack sudo[84957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:17 devstack sudo[84949]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92" returned: 0 in 0.867s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[e320d1fa-bcfd-4c2a-8307-62afbabd2d6f]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:17 devstack sudo[84959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43
Apr 13 20:29:17 devstack sudo[84959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:17 devstack sudo[84957]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525" returned: 0 in 0.602s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f79ab85-e5de-47fa-b500-80bf26977e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65edfdc5-0b76-4939-9241-6adfa4a0d525', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c90f53-5baf-4b19-b217-298b0595a821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:17 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Volume volume-65edfdc5-0b76-4939-9241-6adfa4a0d525 (65edfdc5-0b76-4939-9241-6adfa4a0d525): created successfully
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c90f53-5baf-4b19-b217-298b0595a821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Flow 'volume_create_manager' (b7b39c3b-b26e-4bf5-9c42-6abe29d0dd68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:17 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-7181d55a-a518-474d-8abb-9ad8e5b11a45 req-93ad1efb-250d-4090-8549-6b96ff85d487 tempest-VolumesGetTestJSON-861395355 None] Created volume successfully.
Apr 13 20:29:17 devstack sudo[84959]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43" returned: 0 in 0.626s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:17 devstack sudo[84966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92
Apr 13 20:29:17 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:18 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92" returned: 0 in 0.566s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:18 devstack sudo[84996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92
Apr 13 20:29:18 devstack sudo[84996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Acquiring lock "cinder-65edfdc5-0b76-4939-9241-6adfa4a0d525-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Lock "cinder-65edfdc5-0b76-4939-9241-6adfa4a0d525-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Acquiring lock "cinder-quobyte-65edfdc5-0b76-4939-9241-6adfa4a0d525" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Lock "cinder-quobyte-65edfdc5-0b76-4939-9241-6adfa4a0d525" acquired by "delete_volume" :: waited 0.034s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:18 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1452957b-1d62-4643-9db0-505180bf2ec2]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:18 devstack sudo[85002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525
Apr 13 20:29:18 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:18 devstack sudo[84996]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43.bd403ad1-7d25-4d81-b767-205b4c789f92" returned: 0 in 0.606s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-bd403ad1-7d25-4d81-b767-205b4c789f92" released by "_delete_snapshot" :: held 2.726s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-0214e324-d0f9-474c-ad9b-62b67b4e7b43" released by "delete_snapshot" :: held 2.746s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:19 devstack cinder-volume[82824]: WARNING cinder.quota [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1890242575 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1890242575, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:29:19 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['03f6ebc0-73ea-4488-957b-fc6a0e5afd19', '94991863-8693-4acb-9994-9b595c413449', '60fa8fe0-7215-4b10-abaa-9f4a4c0d991f', '92e1990c-9478-4c6e-9b7b-441620bbe5b9'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:19 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-da580f60-d190-4669-af02-01ea76a4897f tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 744f2262-a650-41dd-9403-5d7557dd7941: deleted successfully
Apr 13 20:29:19 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525" returned: 0 in 0.849s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:19 devstack sudo[85015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525
Apr 13 20:29:19 devstack sudo[85015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-0214e324-d0f9-474c-ad9b-62b67b4e7b43" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-0214e324-d0f9-474c-ad9b-62b67b4e7b43" acquired by "delete_volume" :: waited 0.017s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:19 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[8856588c-31c8-4759-85cd-a33bf990a016]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:20 devstack sudo[85017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43
Apr 13 20:29:20 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:20 devstack sudo[85015]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-65edfdc5-0b76-4939-9241-6adfa4a0d525" returned: 0 in 0.730s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Lock "cinder-quobyte-65edfdc5-0b76-4939-9241-6adfa4a0d525" released by "delete_volume" :: held 1.625s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG cinder.quota [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Created reservations ['928782f5-51c5-4065-a3bb-894db44e2daf', 'ad41855d-4138-46a0-a41f-28d781d33bee', '10c044d8-dbd8-4a61-b2b8-1652384bb0f5', 'def4ca33-191a-4d1d-b7e9-31a4984174e4'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:20 devstack sudo[85021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:29:20 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:20 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.485s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG cinder.manager [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:29:20 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Deleted volume successfully.
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-1484d9e1-82b1-48c1-a124-a08d1c0c2288 req-4f978f90-26ef-4ae8-ae18-6c61eee3e2da tempest-VolumesGetTestJSON-861395355 None] Lock "cinder-65edfdc5-0b76-4939-9241-6adfa4a0d525-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:20 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43" returned: 0 in 0.961s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:20 devstack sudo[85027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43
Apr 13 20:29:20 devstack sudo[85027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:21 devstack sudo[85027]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0214e324-d0f9-474c-ad9b-62b67b4e7b43" returned: 0 in 0.500s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:21 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-0214e324-d0f9-474c-ad9b-62b67b4e7b43" released by "delete_volume" :: held 1.510s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:21 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['e166168b-340c-4229-a85c-ba0f36b8b9d5'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:21 devstack cinder-volume[82824]: WARNING cinder.db.sqlalchemy.api [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1890242575']
Apr 13 20:29:21 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['d99abf9c-6166-4339-8db2-f8609db35248', '77766c5f-7e68-45d7-98c7-fa4e384bb1d6', '485ab903-15bb-43cc-afba-86768ed17d2b', '37562873-4d01-41e5-979d-b14d8c6a3b19'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:21 devstack sudo[85030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:29:21 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:22 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.631s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:22 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:29:22 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-e69e497c-a23d-470e-8116-17ede4e459a8 tempest-GroupSnapshotsTest-1575066988 None] Delete group completed successfully.
Apr 13 20:29:22 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0700a5c9-241d-4717-b01c-6f2c5e02c952 tempest-GroupSnapshotsTest-1575066988 None] Group tempest-GroupSnapshotsTest-Group-2092303076: creating
Apr 13 20:29:22 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0700a5c9-241d-4717-b01c-6f2c5e02c952 tempest-GroupSnapshotsTest-1575066988 None] Group tempest-GroupSnapshotsTest-Group-2092303076: created successfully
Apr 13 20:29:22 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0700a5c9-241d-4717-b01c-6f2c5e02c952 tempest-GroupSnapshotsTest-1575066988 None] Create group completed successfully.
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Flow 'volume_create_manager' (222b44e4-4c1e-497b-b756-7052bc282a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0096fff0-692b-40e3-94d8-f81e7b6651c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0096fff0-692b-40e3-94d8-f81e7b6651c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061425363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d40eb2e5-cffa-4872-89a9-6b6fe2b736c8,host='devstack@QuobyteHD#QuobyteHD',id=c282f911-3cf0-416c-b1a2-f0cec88c5644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7832cdd1637472d9de4e4b2c989d1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:24Z,use_quota=True,user_id='6b0e74bffcd5463da53d2fd1193b497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7931d960-85bf-4d28-96d1-ab72f05f52e6),volume_type_id=7931d960-85bf-4d28-96d1-ab72f05f52e6)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f30aab-477c-4267-a7b3-6274eea71d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f30aab-477c-4267-a7b3-6274eea71d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c593a6ea-53bf-4f51-8e88-1bfee644ad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c593a6ea-53bf-4f51-8e88-1bfee644ad0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c282f911-3cf0-416c-b1a2-f0cec88c5644', 'volume_name': 'volume-c282f911-3cf0-416c-b1a2-f0cec88c5644', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4132ad8-0c16-417b-85a4-d638a88e8d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4132ad8-0c16-417b-85a4-d638a88e8d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0142df-3108-4d16-a72e-39c2c6a0589b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:24 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Volume c282f911-3cf0-416c-b1a2-f0cec88c5644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c282f911-3cf0-416c-b1a2-f0cec88c5644', 'volume_size': 1}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d40eb2e5-cffa-4872-89a9-6b6fe2b736c8,created_at=2026-04-13T18:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061425363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d40eb2e5-cffa-4872-89a9-6b6fe2b736c8,host='devstack@QuobyteHD#QuobyteHD',id=c282f911-3cf0-416c-b1a2-f0cec88c5644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7832cdd1637472d9de4e4b2c989d1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:24Z,use_quota=True,user_id='6b0e74bffcd5463da53d2fd1193b497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7931d960-85bf-4d28-96d1-ab72f05f52e6),volume_type_id=7931d960-85bf-4d28-96d1-ab72f05f52e6)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Creating volume c282f911-3cf0-416c-b1a2-f0cec88c5644 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:29:24 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:24 devstack sudo[85039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 1073741824
Apr 13 20:29:24 devstack sudo[85039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5e9c4835-b2dc-468f-b3eb-0e94ab371e21 tempest-BackendsCapabilitiesAdminTestsJSON-353156725 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82824) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 13 20:29:24 devstack sudo[85039]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 1073741824" returned: 0 in 0.692s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:25 devstack sudo[85051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644
Apr 13 20:29:25 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c44d47aa-66ba-4697-92f1-011786b7b195 tempest-BackendsCapabilitiesAdminTestsJSON-353156725 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82824) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 13 20:29:25 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644" returned: 0 in 0.643s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:25 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:29:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0142df-3108-4d16-a72e-39c2c6a0589b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c282f911-3cf0-416c-b1a2-f0cec88c5644', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bd75be-449a-48f2-a48c-949f73467ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:25 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Volume volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 (c282f911-3cf0-416c-b1a2-f0cec88c5644): created successfully
Apr 13 20:29:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bd75be-449a-48f2-a48c-949f73467ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Flow 'volume_create_manager' (222b44e4-4c1e-497b-b756-7052bc282a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:25 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-ff86c06d-9e04-4247-8cb8-c3a69f16481c tempest-GroupSnapshotsTest-1575066988 None] Created volume successfully.
Apr 13 20:29:26 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Flow 'volume_create_manager' (be314939-7cae-4df6-aa8b-7778ef37af00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc3e5dd-ad1f-4a15-9f06-4ad00050d4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc3e5dd-ad1f-4a15-9f06-4ad00050d4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1383186931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d40eb2e5-cffa-4872-89a9-6b6fe2b736c8,host='devstack@QuobyteHD#QuobyteHD',id=051b3c3a-21d7-4b96-84b7-557bf65257fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7832cdd1637472d9de4e4b2c989d1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:27Z,use_quota=True,user_id='6b0e74bffcd5463da53d2fd1193b497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7931d960-85bf-4d28-96d1-ab72f05f52e6),volume_type_id=7931d960-85bf-4d28-96d1-ab72f05f52e6)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7f5d05-47bd-4441-941e-e4fb874bc793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7f5d05-47bd-4441-941e-e4fb874bc793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5210cf0-3d66-4ace-8334-96ede29f9ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5210cf0-3d66-4ace-8334-96ede29f9ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051b3c3a-21d7-4b96-84b7-557bf65257fd', 'volume_name': 'volume-051b3c3a-21d7-4b96-84b7-557bf65257fd', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d0ab15-77a9-4a0c-bacb-ad5b3962a61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d0ab15-77a9-4a0c-bacb-ad5b3962a61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531e2196-7a13-4262-99d1-c011f0566476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:27 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Volume 051b3c3a-21d7-4b96-84b7-557bf65257fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051b3c3a-21d7-4b96-84b7-557bf65257fd', 'volume_size': 1}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d40eb2e5-cffa-4872-89a9-6b6fe2b736c8,created_at=2026-04-13T18:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1383186931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d40eb2e5-cffa-4872-89a9-6b6fe2b736c8,host='devstack@QuobyteHD#QuobyteHD',id=051b3c3a-21d7-4b96-84b7-557bf65257fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7832cdd1637472d9de4e4b2c989d1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:27Z,use_quota=True,user_id='6b0e74bffcd5463da53d2fd1193b497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7931d960-85bf-4d28-96d1-ab72f05f52e6),volume_type_id=7931d960-85bf-4d28-96d1-ab72f05f52e6)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Creating volume 051b3c3a-21d7-4b96-84b7-557bf65257fd {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:29:27 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:27 devstack sudo[85071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd 1073741824
Apr 13 20:29:27 devstack sudo[85071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:27 devstack sudo[85071]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd 1073741824" returned: 0 in 0.716s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:27 devstack sudo[85089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd
Apr 13 20:29:27 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:28 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd" returned: 0 in 0.729s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:29:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531e2196-7a13-4262-99d1-c011f0566476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051b3c3a-21d7-4b96-84b7-557bf65257fd', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad2b2af-dc0f-4650-b2ab-48c97177babf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:28 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Volume volume-051b3c3a-21d7-4b96-84b7-557bf65257fd (051b3c3a-21d7-4b96-84b7-557bf65257fd): created successfully
Apr 13 20:29:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad2b2af-dc0f-4650-b2ab-48c97177babf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Flow 'volume_create_manager' (be314939-7cae-4df6-aa8b-7778ef37af00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:28 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-575c7d1a-f161-46de-a6f9-98f128abd506 tempest-GroupSnapshotsTest-1575066988 None] Created volume successfully.
Apr 13 20:29:29 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-625252d6-13ad-4334-ad5d-fda9708547ef tempest-GroupSnapshotsTest-1575066988 None] Update group completed successfully.
Apr 13 20:29:30 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:29:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Flow 'volume_create_manager' (9072b7a2-8c81-4b00-80b9-34c812c0b02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189b53d6-cb1a-47a7-bfc7-a9408a02561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189b53d6-cb1a-47a7-bfc7-a9408a02561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:29:30Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b136e3da-1ff9-4877-b63a-48ab0b6dfb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3454d5f86b42b8adc72c7b4a9b3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:31Z,use_quota=True,user_id='3fd7a1661e3c44e5bcd46bb662f9a318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0821793f-4ae0-40ae-9cbe-3469bfc22358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0821793f-4ae0-40ae-9cbe-3469bfc22358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8f0dca-d337-4e96-9c28-263ce454e5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:30 devstack cinder-volume[82824]: DEBUG cinder.image.glance [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Creating Keystone auth plugin from conf {{(pid=82824) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 20:29:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-724352b0-249c-4504-a7c8-4ef9b8d662c5 tempest-GroupSnapshotsTest-1575066988 None] Update group completed successfully.
Apr 13 20:29:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8f0dca-d337-4e96-9c28-263ce454e5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b136e3da-1ff9-4877-b63a-48ab0b6dfb0e', 'volume_name': 'volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f06317e0>}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03dd01ef-6742-4155-a259-b16fa9a6f4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03dd01ef-6742-4155-a259-b16fa9a6f4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f5c3bf-5840-4ed8-9098-a31bf248b9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:31 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Volume b136e3da-1ff9-4877-b63a-48ab0b6dfb0e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f06317e0>}
Apr 13 20:29:31 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Trying to clone b136e3da-1ff9-4877-b63a-48ab0b6dfb0e from image 1af62cce-55dd-41f2-805b-b88f968d7cf0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]). {{(pid=82824) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 20:29:32 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 20:29:32 devstack cinder-volume[82824]: INFO cinder.image.image_utils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 20:29:32 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0bf22c-b707-431c-b7f4-c529fbfa90a4]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:32 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c76382b9-67cd-49d6-b3db-62a0f761f6fd tempest-GroupSnapshotsTest-1575066988 None] Update group completed successfully.
Apr 13 20:29:32 devstack sudo[85206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD
Apr 13 20:29:32 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:33 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD" returned: 0 in 1.478s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:33 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Temporary image 1af62cce-55dd-41f2-805b-b88f968d7cf0 is fetched for user 3fd7a1661e3c44e5bcd46bb662f9a318. {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 20:29:33 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-9cb13ea8-7ae8-4321-83a4-ed92c68b8dd1 tempest-GroupSnapshotsTest-1575066988 None] Update group completed successfully.
Apr 13 20:29:33 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c37c99-1171-45bc-9300-5e250376a71c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:34 devstack sudo[85216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD
Apr 13 20:29:34 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:34 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD" returned: 0 in 0.814s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:29:30Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b136e3da-1ff9-4877-b63a-48ab0b6dfb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3454d5f86b42b8adc72c7b4a9b3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:31Z,use_quota=True,user_id='3fd7a1661e3c44e5bcd46bb662f9a318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Creating volume b136e3da-1ff9-4877-b63a-48ab0b6dfb0e {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:29:34 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:29:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:34 devstack sudo[85221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e 1073741824
Apr 13 20:29:34 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:35 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] GroupSnapshot 992826f0-0136-45b1-b38b-7eeb144a85ae: creating.
Apr 13 20:29:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Group snapshot 992826f0-0136-45b1-b38b-7eeb144a85ae: creating. {{(pid=82824) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 20:29:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:36 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e 1073741824" returned: 0 in 1.509s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:36 devstack sudo[85228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e
Apr 13 20:29:36 devstack sudo[85228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:37 devstack sudo[85228]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" returned: 0 in 0.908s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] <== create_volume: return (2468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:29:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.473s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.937s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Creating offline snapshot 030a701c-d88e-4402-af6e-e7c4c7bfebbf of volume c282f911-3cf0-416c-b1a2-f0cec88c5644 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:29:37 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Attempting download of 1af62cce-55dd-41f2-805b-b88f968d7cf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}])) to volume b136e3da-1ff9-4877-b63a-48ab0b6dfb0e. {{(pid=82824) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 20:29:37 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[470cc1e5-9638-4fc2-a957-5b78a6f723d3]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:37 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef668cf6-78f2-4f7d-883b-a420dda5bd6e]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_ohn7km81 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:37 devstack sudo[85231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644
Apr 13 20:29:37 devstack sudo[85231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:37 devstack sudo[85233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_ohn7km81
Apr 13 20:29:37 devstack sudo[85233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:38 devstack sudo[85233]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_ohn7km81" returned: 0 in 0.908s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_ohn7km81 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:38 devstack sudo[85239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_ohn7km81
Apr 13 20:29:38 devstack sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:38 devstack sudo[85231]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644" returned: 0 in 1.206s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:38 devstack sudo[85242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf 1G
Apr 13 20:29:38 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Flow 'volume_create_manager' (6cb4d984-ac70-4763-b713-9c7e9e51f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f573c1-d980-474e-bb06-47ab130046a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f573c1-d980-474e-bb06-47ab130046a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1793450570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e7cb60-933a-46d9-8aa8-daac16bdb935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d261e5cb4db94cfd842498a4f4dc2906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:39Z,use_quota=True,user_id='0eb26893995d4daf890fcbc860195150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ec6d6e-d8d9-4315-83d7-c021fc7f00d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ec6d6e-d8d9-4315-83d7-c021fc7f00d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13a2326-45f4-4771-a004-0ac1a363c9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13a2326-45f4-4771-a004-0ac1a363c9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e7cb60-933a-46d9-8aa8-daac16bdb935', 'volume_name': 'volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3959735f-8286-4422-a6cc-1b41a07f9b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3959735f-8286-4422-a6cc-1b41a07f9b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb124291-e1a8-43a6-9053-766c96aa39c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:39 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Volume d6e7cb60-933a-46d9-8aa8-daac16bdb935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935', 'volume_size': 1}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:39 devstack sudo[85239]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_ohn7km81" returned: 1 in 1.081s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_ohn7km81' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a477266-109d-49f9-bf72-5db0b617a74f]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:39 devstack sudo[85249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD
Apr 13 20:29:39 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:40 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf 1G" returned: 0 in 1.437s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:40 devstack sudo[85255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf
Apr 13 20:29:40 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:40 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD" returned: 0 in 0.608s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:40 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] 1af62cce-55dd-41f2-805b-b88f968d7cf0 was qcow2, converting to raw {{(pid=82824) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 20:29:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:40 devstack sudo[85257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e
Apr 13 20:29:40 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:40 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf" returned: 0 in 0.919s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:40 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:29:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:41 devstack sudo[85301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf
Apr 13 20:29:41 devstack sudo[85301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:41 devstack sudo[85301]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf" returned: 0 in 0.558s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:41 devstack sudo[85306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.info
Apr 13 20:29:41 devstack sudo[85306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:41 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" returned: 0 in 1.585s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:41 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_kqa6qul8devstack@QuobyteHD, size 112.00 MB, duration 1.59 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:29:41 devstack cinder-volume[82824]: INFO cinder.image.image_utils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Converted 112.00 MB image at 70.59 MB/s
Apr 13 20:29:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:41 devstack sudo[85313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e 1G
Apr 13 20:29:41 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:42 devstack sudo[85306]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.info" returned: 0 in 0.502s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:42 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:42 devstack sudo[85316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.info
Apr 13 20:29:42 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:42 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e 1G" returned: 0 in 0.551s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce24d2e5-92b4-447d-b8a6-fdf94271cba0]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:42 devstack sudo[85321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e
Apr 13 20:29:42 devstack sudo[85321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:42 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.info" returned: 0 in 0.489s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.261s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Creating offline snapshot 0325dae3-dfa9-43e6-b8cb-32a6b51925f7 of volume 051b3c3a-21d7-4b96-84b7-557bf65257fd {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4a2ad7-7465-4cf8-8f24-597d02946f65]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:42 devstack sudo[85324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd
Apr 13 20:29:42 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:42 devstack sudo[85321]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" returned: 0 in 0.507s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:42 devstack sudo[85330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e
Apr 13 20:29:42 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:43 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd" returned: 0 in 0.499s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:43 devstack sudo[85336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7 1G
Apr 13 20:29:43 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:43 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" returned: 1 in 0.548s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Downloaded image 1af62cce-55dd-41f2-805b-b88f968d7cf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}])) to volume b136e3da-1ff9-4877-b63a-48ab0b6dfb0e successfully. {{(pid=82824) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Temporary image 1af62cce-55dd-41f2-805b-b88f968d7cf0 for user 3fd7a1661e3c44e5bcd46bb662f9a318 is deleted. {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Marking volume b136e3da-1ff9-4877-b63a-48ab0b6dfb0e as bootable. {{(pid=82824) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Copying metadata from image 1af62cce-55dd-41f2-805b-b88f968d7cf0 to b136e3da-1ff9-4877-b63a-48ab0b6dfb0e. {{(pid=82824) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Creating volume glance metadata for volume b136e3da-1ff9-4877-b63a-48ab0b6dfb0e backed by image 1af62cce-55dd-41f2-805b-b88f968d7cf0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82824) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f5c3bf-5840-4ed8-9098-a31bf248b9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f06317e0>}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01023826-3d09-4294-919d-aab8b20a7b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:43 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Volume volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e (b136e3da-1ff9-4877-b63a-48ab0b6dfb0e): created successfully
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01023826-3d09-4294-919d-aab8b20a7b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Flow 'volume_create_manager' (9072b7a2-8c81-4b00-80b9-34c812c0b02f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:43 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-eb55ad34-d12c-4126-a117-056187e39b3f tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Created volume successfully.
Apr 13 20:29:43 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7 1G" returned: 0 in 0.566s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051b3c3a-21d7-4b96-84b7-557bf65257fd -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:43 devstack sudo[85344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051b3c3a-21d7-4b96-84b7-557bf65257fd -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7
Apr 13 20:29:43 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:44 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051b3c3a-21d7-4b96-84b7-557bf65257fd -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7" returned: 0 in 0.447s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:44 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:29:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:44 devstack sudo[85350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7
Apr 13 20:29:44 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:44 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7" returned: 0 in 0.423s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:44 devstack sudo[85353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.info
Apr 13 20:29:44 devstack sudo[85353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:45 devstack sudo[85353]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.info" returned: 0 in 0.456s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:45 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:45 devstack sudo[85356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.info
Apr 13 20:29:45 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:45 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.info" returned: 0 in 0.513s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.234s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1793450570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e7cb60-933a-46d9-8aa8-daac16bdb935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d261e5cb4db94cfd842498a4f4dc2906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:39Z,use_quota=True,user_id='0eb26893995d4daf890fcbc860195150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Creating volume d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:29:45 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:29:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:45 devstack sudo[85395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 1073741824
Apr 13 20:29:45 devstack sudo[85395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:45 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1ba7eb53-4b60-43cd-b412-18be34a3c0b3 tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 992826f0-0136-45b1-b38b-7eeb144a85ae: created successfully
Apr 13 20:29:46 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 992826f0-0136-45b1-b38b-7eeb144a85ae: deleting
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 992826f0-0136-45b1-b38b-7eeb144a85ae: deleting {{(pid=82824) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-c282f911-3cf0-416c-b1a2-f0cec88c5644" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-c282f911-3cf0-416c-b1a2-f0cec88c5644" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-030a701c-d88e-4402-af6e-e7c4c7bfebbf" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-030a701c-d88e-4402-af6e-e7c4c7bfebbf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Deleting offline snapshot 030a701c-d88e-4402-af6e-e7c4c7bfebbf of volume c282f911-3cf0-416c-b1a2-f0cec88c5644 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] snapshot_file for this snap is: volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c02dc3-adfa-4386-af89-59d64c0fb509]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:46 devstack sudo[85400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf
Apr 13 20:29:46 devstack sudo[85400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:46 devstack sudo[85395]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 1073741824" returned: 0 in 1.211s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-72d7b9fc-301f-4341-8f65-b7f5ef8772e7 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:46 devstack sudo[85413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935
Apr 13 20:29:46 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:47 devstack sudo[85400]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf" returned: 0 in 0.719s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c282f911-3cf0-416c-b1a2-f0cec88c5644(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ae3e85-e790-494c-9084-a29c470235f1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:47 devstack sudo[85418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644
Apr 13 20:29:47 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:47 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935" returned: 0 in 0.494s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-72d7b9fc-301f-4341-8f65-b7f5ef8772e7 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.488s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb124291-e1a8-43a6-9053-766c96aa39c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c54d204-59cb-4448-9293-d69601eb850e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1caad22-97b6-4e04-8227-5e82c1bd3cd8]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-72d7b9fc-301f-4341-8f65-b7f5ef8772e7 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:47 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Volume volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 (d6e7cb60-933a-46d9-8aa8-daac16bdb935): created successfully
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c54d204-59cb-4448-9293-d69601eb850e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Flow 'volume_create_manager' (6cb4d984-ac70-4763-b713-9c7e9e51f138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:47 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-69f7871e-650b-4c72-8a9a-e0ef98c8d9b5 tempest-SnapshotsActionsTest-1405708669 None] Created volume successfully.
Apr 13 20:29:47 devstack sudo[85421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e
Apr 13 20:29:47 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:47 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644" returned: 0 in 0.730s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:47 devstack sudo[85426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf
Apr 13 20:29:47 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Flow 'volume_create_manager' (247d16e7-5fad-4ff5-bfb5-59c3c8e3e18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3756ee0-9f9c-4c0b-a503-325766ef66cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3756ee0-9f9c-4c0b-a503-325766ef66cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1515035729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3776e79cd8c7405d87bda8d3d63e292f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:48Z,use_quota=True,user_id='cd3bb556af5b445cac85b4b7dde8caff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bf32c0-3914-4312-b2e6-af24ed0ba954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bf32c0-3914-4312-b2e6-af24ed0ba954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925e1077-1543-4626-9b8b-d4c403b5a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925e1077-1543-4626-9b8b-d4c403b5a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb', 'volume_name': 'volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef447a33-d213-437f-87ff-82703705f37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef447a33-d213-437f-87ff-82703705f37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6d7a48-39f8-41c2-a675-6b81cdc0ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:48 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Volume b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb', 'volume_size': 1}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:48 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-72d7b9fc-301f-4341-8f65-b7f5ef8772e7 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" returned: 0 in 1.237s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-72d7b9fc-301f-4341-8f65-b7f5ef8772e7 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:48 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf" returned: 0 in 0.799s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:48 devstack sudo[85435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf
Apr 13 20:29:48 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:48 devstack sudo[85434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e
Apr 13 20:29:48 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:49 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644.030a701c-d88e-4402-af6e-e7c4c7bfebbf" returned: 0 in 0.506s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-030a701c-d88e-4402-af6e-e7c4c7bfebbf" released by "_delete_snapshot" :: held 2.927s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-c282f911-3cf0-416c-b1a2-f0cec88c5644" released by "delete_snapshot" :: held 2.954s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-051b3c3a-21d7-4b96-84b7-557bf65257fd" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-051b3c3a-21d7-4b96-84b7-557bf65257fd" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-0325dae3-dfa9-43e6-b8cb-32a6b51925f7" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-0325dae3-dfa9-43e6-b8cb-32a6b51925f7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Deleting offline snapshot 0325dae3-dfa9-43e6-b8cb-32a6b51925f7 of volume 051b3c3a-21d7-4b96-84b7-557bf65257fd {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] snapshot_file for this snap is: volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8099c2-efdb-4a0c-8258-3940c5e808e0]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:49 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-72d7b9fc-301f-4341-8f65-b7f5ef8772e7 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" returned: 1 in 0.670s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-72d7b9fc-301f-4341-8f65-b7f5ef8772e7 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-72d7b9fc-301f-4341-8f65-b7f5ef8772e7 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.949s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.205s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] Creating offline snapshot 93465b58-9038-4336-ad50-b7b0fe3c0bbb of volume d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[811a8488-4c7a-4a1f-892d-54ce5a28222c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-72d7b9fc-301f-4341-8f65-b7f5ef8772e7 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b', 'name': 'volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '392630ff-a904-4877-8d01-5e076a2e63b9', 'enforce_multipath': True} {{(pid=82824) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 20:29:49 devstack sudo[85443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7
Apr 13 20:29:49 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:49 devstack sudo[85444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935
Apr 13 20:29:49 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:49 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-2d9366c9-66ac-4f42-9c11-99fd224dbc08 req-72d7b9fc-301f-4341-8f65-b7f5ef8772e7 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] attachment_update completed successfully.
Apr 13 20:29:49 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7" returned: 0 in 0.684s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051b3c3a-21d7-4b96-84b7-557bf65257fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:29:49 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935" returned: 0 in 0.662s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df8523d-c2bb-41a0-a6da-b398258b53c1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:49 devstack sudo[85453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb 1G
Apr 13 20:29:49 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:50 devstack sudo[85454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd
Apr 13 20:29:50 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:50 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd" returned: 0 in 0.758s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:50 devstack sudo[85463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7
Apr 13 20:29:50 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:51 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb 1G" returned: 0 in 1.126s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:51 devstack sudo[85465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:29:51 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:51 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7" returned: 0 in 0.658s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:51 devstack sudo[85470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7
Apr 13 20:29:51 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:51 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.636s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:51 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb is being set with open permissions: ugo+rw
Apr 13 20:29:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:51 devstack sudo[85540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:29:51 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:52 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd.0325dae3-dfa9-43e6-b8cb-32a6b51925f7" returned: 0 in 0.632s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-0325dae3-dfa9-43e6-b8cb-32a6b51925f7" released by "_delete_snapshot" :: held 2.855s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-051b3c3a-21d7-4b96-84b7-557bf65257fd" released by "delete_snapshot" :: held 2.866s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:52 devstack cinder-volume[82824]: WARNING cinder.quota [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1714205211 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1714205211, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:29:52 devstack cinder-volume[82824]: WARNING cinder.quota [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1714205211 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1714205211, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:29:52 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['4418db4f-854f-46da-bd45-68471279dc05', '8b249262-4d3c-4ffb-a258-bac708f653d3', 'bf8d26d7-1bdc-4550-af12-05cb659c995a', '0a6842d7-a73b-4027-b9a5-8eb24d76c3a6'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:52 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['0c9f6680-9510-4f42-a73f-92409e63ced4', 'e4ac4082-8464-4f15-8941-a14255b81c19', '02c0b4a6-e553-425a-932d-1e06b56e2692', 'ac63b2ad-06c2-4715-900d-7190b1004b47'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:52 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-91ee0960-51a6-41a0-843c-e211fc94eed7 tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 992826f0-0136-45b1-b38b-7eeb144a85ae: deleted successfully
Apr 13 20:29:52 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.623s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:52 devstack sudo[85546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.info
Apr 13 20:29:52 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:52 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.info" returned: 0 in 0.433s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:52 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.info is being set with open permissions: ugo+rw
Apr 13 20:29:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:52 devstack sudo[85549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.info
Apr 13 20:29:52 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-051b3c3a-21d7-4b96-84b7-557bf65257fd" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-051b3c3a-21d7-4b96-84b7-557bf65257fd" acquired by "delete_volume" :: waited 0.022s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[8872cbca-0133-4e6a-9035-83a021c58a74]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:53 devstack sudo[85559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd
Apr 13 20:29:53 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:53 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.info" returned: 0 in 0.620s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.185s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.916s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1515035729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3776e79cd8c7405d87bda8d3d63e292f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:29:48Z,use_quota=True,user_id='cd3bb556af5b445cac85b4b7dde8caff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Creating volume b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:29:53 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:53 devstack sudo[85570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb 1073741824
Apr 13 20:29:53 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:53 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-db84a3ff-ee26-4c37-9b84-98b7727ed70e tempest-SnapshotsActionsTest-1405708669 None] Create snapshot completed successfully
Apr 13 20:29:53 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd" returned: 0 in 0.591s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:53 devstack sudo[85577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd
Apr 13 20:29:53 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:54 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb 1073741824" returned: 0 in 0.629s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:54 devstack sudo[85580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb
Apr 13 20:29:54 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:54 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-051b3c3a-21d7-4b96-84b7-557bf65257fd" returned: 0 in 0.551s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-051b3c3a-21d7-4b96-84b7-557bf65257fd" released by "delete_volume" :: held 1.211s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-c282f911-3cf0-416c-b1a2-f0cec88c5644" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:29:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-c282f911-3cf0-416c-b1a2-f0cec88c5644" acquired by "delete_volume" :: waited 0.080s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:29:54 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[18820a6c-879e-4201-841b-66c24599d419]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:54 devstack sudo[85602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644
Apr 13 20:29:54 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:55 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb" returned: 0 in 0.985s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6d7a48-39f8-41c2-a675-6b81cdc0ead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc67b6ec-b939-4242-b3b9-352d77a66751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:55 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Volume volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb (b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb): created successfully
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc67b6ec-b939-4242-b3b9-352d77a66751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Flow 'volume_create_manager' (247d16e7-5fad-4ff5-bfb5-59c3c8e3e18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:55 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5cff5c2a-5122-45bc-809c-1816212c98ee tempest-ServerRescueNegativeTestJSON-561496567 None] Created volume successfully.
Apr 13 20:29:55 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644" returned: 0 in 0.806s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:55 devstack sudo[85934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644
Apr 13 20:29:55 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] Creating offline snapshot 8920848e-bf83-4d75-bf9d-1fb889b88880 of volume d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7483265-9301-411e-a86b-1ddabd767c76]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:29:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:55 devstack sudo[85937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:29:55 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:56 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c282f911-3cf0-416c-b1a2-f0cec88c5644" returned: 0 in 0.720s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-c282f911-3cf0-416c-b1a2-f0cec88c5644" released by "delete_volume" :: held 1.615s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:29:56 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.648s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['b008aaa6-275f-498d-8065-15a43d7404cb'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:56 devstack sudo[85944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880 1G
Apr 13 20:29:56 devstack sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:56 devstack cinder-volume[82824]: WARNING cinder.quota [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1714205211 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1714205211, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['ec167223-3912-47d6-81e6-eba3be42f7c1', '9fc2ff86-9be5-48f7-86e7-2b5675342290', '5af95493-46ec-4132-b2c9-11ff50decbe0', '0c704ef1-7e35-49df-a2d7-7cee1fa75061'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['4089ee3a-8aac-44e5-a208-b4f9b1c87fe0', '72fc9873-19a9-4be6-a107-1cf9d7c63db2', '8b30f31b-b247-4ae6-a281-2d1f488ed727', '74694790-7fc2-4e1e-bf99-30e061f5072d'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:56 devstack sudo[85947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:29:56 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:57 devstack sudo[85944]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880 1G" returned: 0 in 1.169s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:57 devstack sudo[85953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880
Apr 13 20:29:57 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:57 devstack cinder-volume[82824]: DEBUG oslo_service.periodic_task [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82824) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:57 devstack sudo[85956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:29:57 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:57 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 1.273s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:57 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:29:57 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-509cb9b9-100b-4000-bf77-281cc7efd501 tempest-GroupSnapshotsTest-1575066988 None] Delete group completed successfully.
Apr 13 20:29:58 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1d67b612-1589-43fc-a1be-12cc67d1bbc0 tempest-GroupSnapshotsTest-1575066988 None] Group tempest-GroupSnapshotsTest-Group-2115914828: creating
Apr 13 20:29:58 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1d67b612-1589-43fc-a1be-12cc67d1bbc0 tempest-GroupSnapshotsTest-1575066988 None] Group tempest-GroupSnapshotsTest-Group-2115914828: created successfully
Apr 13 20:29:58 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1d67b612-1589-43fc-a1be-12cc67d1bbc0 tempest-GroupSnapshotsTest-1575066988 None] Create group completed successfully.
Apr 13 20:29:58 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880" returned: 0 in 1.173s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:58 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880 is being set with open permissions: ugo+rw
Apr 13 20:29:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:58 devstack sudo[85965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880
Apr 13 20:29:58 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:29:58 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 1.213s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:29:59 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880" returned: 0 in 0.920s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.061s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:59 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2894a21e-0eec-442c-a749-35014e8a9a31 tempest-SnapshotsActionsTest-1405708669 None] Create snapshot completed successfully
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Flow 'volume_create_manager' (69bae61e-2e59-4645-bfd1-9a4dea62b188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ceb4a2-a28d-4fae-84e1-c1d87787ce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ceb4a2-a28d-4fae-84e1-c1d87787ce94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1168385760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=21553854-a4b5-4002-96c3-48ae31e6e986,host='devstack@QuobyteHD#QuobyteHD',id=fe3e18e0-b2e9-4679-87da-6208f509c313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7832cdd1637472d9de4e4b2c989d1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:00Z,use_quota=True,user_id='6b0e74bffcd5463da53d2fd1193b497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c64295d2-43be-46f0-8cf0-f1fea4e3d9ed),volume_type_id=c64295d2-43be-46f0-8cf0-f1fea4e3d9ed)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ce067e-409d-4577-abcc-17a0777d4811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ce067e-409d-4577-abcc-17a0777d4811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845bb731-420c-4c10-8dd1-6f579d0b6a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845bb731-420c-4c10-8dd1-6f579d0b6a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe3e18e0-b2e9-4679-87da-6208f509c313', 'volume_name': 'volume-fe3e18e0-b2e9-4679-87da-6208f509c313', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867932e3-c971-403d-9ad7-a32a7e821b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867932e3-c971-403d-9ad7-a32a7e821b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df974aca-ca64-47d1-9fa4-17216bcfc28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:29:59 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Volume fe3e18e0-b2e9-4679-87da-6208f509c313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe3e18e0-b2e9-4679-87da-6208f509c313', 'volume_size': 1}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=21553854-a4b5-4002-96c3-48ae31e6e986,created_at=2026-04-13T18:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1168385760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=21553854-a4b5-4002-96c3-48ae31e6e986,host='devstack@QuobyteHD#QuobyteHD',id=fe3e18e0-b2e9-4679-87da-6208f509c313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7832cdd1637472d9de4e4b2c989d1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:00Z,use_quota=True,user_id='6b0e74bffcd5463da53d2fd1193b497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c64295d2-43be-46f0-8cf0-f1fea4e3d9ed),volume_type_id=c64295d2-43be-46f0-8cf0-f1fea4e3d9ed)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Creating volume fe3e18e0-b2e9-4679-87da-6208f509c313 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:29:59 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:29:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:29:59 devstack sudo[85979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313 1073741824
Apr 13 20:29:59 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-8920848e-bf83-4d75-bf9d-1fb889b88880-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-8920848e-bf83-4d75-bf9d-1fb889b88880-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-quobyte-8920848e-bf83-4d75-bf9d-1fb889b88880" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-8920848e-bf83-4d75-bf9d-1fb889b88880" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Deleting offline snapshot 8920848e-bf83-4d75-bf9d-1fb889b88880 of volume d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:30:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] snapshot_file for this snap is: volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:30:00 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b571b5e-3a9f-41a7-9f9b-5db1ddabcd6c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:00 devstack sudo[85981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880
Apr 13 20:30:00 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:00 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313 1073741824" returned: 0 in 1.109s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:01 devstack sudo[86019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313
Apr 13 20:30:01 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:01 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880" returned: 0 in 1.081s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:01 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:01 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddd51c6-53f8-4f4f-94af-cf2290a53158]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:01 devstack sudo[86025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:30:01 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:02 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313" returned: 0 in 0.984s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:02 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df974aca-ca64-47d1-9fa4-17216bcfc28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe3e18e0-b2e9-4679-87da-6208f509c313', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855e6186-5c63-4e35-8724-abc9e7a90c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.703s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:02 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Volume volume-fe3e18e0-b2e9-4679-87da-6208f509c313 (fe3e18e0-b2e9-4679-87da-6208f509c313): created successfully
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855e6186-5c63-4e35-8724-abc9e7a90c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Flow 'volume_create_manager' (69bae61e-2e59-4645-bfd1-9a4dea62b188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:02 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f6dad688-33f5-4504-a9a7-d0f469187012 tempest-GroupSnapshotsTest-1575066988 None] Created volume successfully.
Apr 13 20:30:02 devstack sudo[86038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880
Apr 13 20:30:02 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:02 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880" returned: 0 in 0.625s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:02 devstack sudo[86044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880
Apr 13 20:30:02 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:03 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.8920848e-bf83-4d75-bf9d-1fb889b88880" returned: 0 in 0.488s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-8920848e-bf83-4d75-bf9d-1fb889b88880" released by "_delete_snapshot" :: held 3.038s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" released by "delete_snapshot" :: held 3.054s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:03 devstack cinder-volume[82824]: WARNING cinder.quota [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:30:03 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Created reservations ['41d5df86-ad84-44b9-9ae7-d21e3dec3f0f', 'c64e29e2-a8a6-4799-964f-0c2a0d93d25b', 'f55e5ccb-23f4-4c82-8c41-00be9f43db78', 'ca04cf6e-16db-4f8b-894d-3e14c013ca42'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:03 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Delete snapshot completed successfully.
Apr 13 20:30:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a854f026-722c-4c05-87f1-07048fe8f5a5 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-8920848e-bf83-4d75-bf9d-1fb889b88880-delete_snapshot" released by "delete_snapshot" :: held 3.210s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:03 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] GroupSnapshot 82ad14d0-8b98-4b72-bec2-70d40a080127: creating.
Apr 13 20:30:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] Group snapshot 82ad14d0-8b98-4b72-bec2-70d40a080127: creating. {{(pid=82824) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 20:30:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] Creating offline snapshot e2ed644b-bda8-4b02-bd6a-163130b6258b of volume fe3e18e0-b2e9-4679-87da-6208f509c313 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:30:03 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c35357-fbef-4f73-88ef-10594a86a75c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:03 devstack sudo[86087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313
Apr 13 20:30:03 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:04 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313" returned: 0 in 0.603s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:04 devstack sudo[86094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b 1G
Apr 13 20:30:04 devstack sudo[86094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:04 devstack sudo[86094]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b 1G" returned: 0 in 0.619s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe3e18e0-b2e9-4679-87da-6208f509c313 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:04 devstack sudo[86099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe3e18e0-b2e9-4679-87da-6208f509c313 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b
Apr 13 20:30:04 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:05 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe3e18e0-b2e9-4679-87da-6208f509c313 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b" returned: 0 in 0.772s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:05 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:30:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:05 devstack sudo[86165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b
Apr 13 20:30:05 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:06 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b" returned: 0 in 0.570s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:06 devstack sudo[86171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.info
Apr 13 20:30:06 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:06 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.info" returned: 0 in 0.440s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:06 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:30:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:06 devstack sudo[86174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.info
Apr 13 20:30:06 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:06 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.info" returned: 0 in 0.424s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.516s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.307s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] Creating offline snapshot db25a17a-0f56-4489-a493-cbdbee47e2d7 of volume d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:30:07 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[454ec33e-ca56-4cc2-a4e5-efea3110ad02]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:07 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-99a1a22a-53d4-4bc8-b125-002f32798aa9 tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 82ad14d0-8b98-4b72-bec2-70d40a080127: created successfully
Apr 13 20:30:07 devstack sudo[86177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:30:07 devstack sudo[86177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:07 devstack sudo[86177]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.640s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:07 devstack sudo[86183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7 1G
Apr 13 20:30:07 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:07 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 82ad14d0-8b98-4b72-bec2-70d40a080127: deleting
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 82ad14d0-8b98-4b72-bec2-70d40a080127: deleting {{(pid=82824) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-fe3e18e0-b2e9-4679-87da-6208f509c313" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-fe3e18e0-b2e9-4679-87da-6208f509c313" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-e2ed644b-bda8-4b02-bd6a-163130b6258b" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-e2ed644b-bda8-4b02-bd6a-163130b6258b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Deleting offline snapshot e2ed644b-bda8-4b02-bd6a-163130b6258b of volume fe3e18e0-b2e9-4679-87da-6208f509c313 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] snapshot_file for this snap is: volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[135e4b3a-9d84-450e-8ef5-c6f310878b9e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:08 devstack sudo[86187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b
Apr 13 20:30:08 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:08 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7 1G" returned: 0 in 1.062s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:08 devstack sudo[86195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7
Apr 13 20:30:08 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:08 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b" returned: 0 in 0.727s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe3e18e0-b2e9-4679-87da-6208f509c313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff2fb92-c42b-43b1-8241-5fbe8539b1b8]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:09 devstack sudo[86197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313
Apr 13 20:30:09 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:09 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7" returned: 0 in 0.646s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:09 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7 is being set with open permissions: ugo+rw
Apr 13 20:30:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:09 devstack sudo[86203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7
Apr 13 20:30:09 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:09 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313" returned: 0 in 0.974s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:09 devstack sudo[86232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b
Apr 13 20:30:09 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:10 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7" returned: 0 in 0.845s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.280s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:10 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0e14be79-b4fc-4957-9991-1e8ccbb1b0ec tempest-SnapshotsActionsTest-1405708669 None] Create snapshot completed successfully
Apr 13 20:30:11 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b" returned: 0 in 1.122s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:11 devstack sudo[86331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b
Apr 13 20:30:11 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-db25a17a-0f56-4489-a493-cbdbee47e2d7-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-db25a17a-0f56-4489-a493-cbdbee47e2d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-quobyte-db25a17a-0f56-4489-a493-cbdbee47e2d7" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-db25a17a-0f56-4489-a493-cbdbee47e2d7" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Deleting offline snapshot db25a17a-0f56-4489-a493-cbdbee47e2d7 of volume d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] snapshot_file for this snap is: volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[96088299-0da6-4289-9a20-7c0acaf7565e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:11 devstack sudo[86335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7
Apr 13 20:30:11 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:11 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313.e2ed644b-bda8-4b02-bd6a-163130b6258b" returned: 0 in 0.967s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-e2ed644b-bda8-4b02-bd6a-163130b6258b" released by "_delete_snapshot" :: held 4.054s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-fe3e18e0-b2e9-4679-87da-6208f509c313" released by "delete_snapshot" :: held 4.087s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=140,cinder:UPDATE=107,cinder:INSERT=34,cinder:DELETE=5 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:UPDATE=117,cinder:SELECT=111,cinder:INSERT=29,cinder:DELETE=6 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Acquiring lock "cinder-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:12 devstack cinder-volume[82824]: WARNING cinder.quota [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1474982521 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1474982521, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:30:12 devstack cinder-volume[82824]: WARNING cinder.quota [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1474982521 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1474982521, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['5c64978c-ed0e-46df-9085-1566508b82f9', 'b1772a9d-0e3c-49b4-bb7a-47d72b5b01c7', 'a4ace810-e779-4686-93f9-dc4301e8c602', 'b9e1b170-4cde-44ec-93f3-2645352d205b'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Lock "cinder-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:12 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7" returned: 0 in 1.083s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Acquiring lock "cinder-quobyte-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:12 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-83359555-576a-4c99-a7cb-38234d9f2a90 tempest-GroupSnapshotsTest-1575066988 None] group_snapshot 82ad14d0-8b98-4b72-bec2-70d40a080127: deleted successfully
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a778ed-e6a1-460b-b3ca-34fa11038f05]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Lock "cinder-quobyte-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb" acquired by "delete_volume" :: waited 0.023s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d21c9f-4094-4413-a8b2-223104eaaa2c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:12 devstack sudo[86369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:30:12 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:12 devstack sudo[86371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb
Apr 13 20:30:12 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:13 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.828s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:13 devstack sudo[86381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7
Apr 13 20:30:13 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:13 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb" returned: 0 in 0.841s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:13 devstack sudo[86383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb
Apr 13 20:30:13 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "cinder-quobyte-fe3e18e0-b2e9-4679-87da-6208f509c313" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-fe3e18e0-b2e9-4679-87da-6208f509c313" acquired by "delete_volume" :: waited 0.018s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bb1a5d-d483-4900-b1cc-dd5bd3e8b8d5]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:14 devstack sudo[86388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313
Apr 13 20:30:14 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:14 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7" returned: 0 in 1.178s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:14 devstack sudo[86423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7
Apr 13 20:30:14 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:14 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb" returned: 0 in 1.135s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Lock "cinder-quobyte-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb" released by "delete_volume" :: held 2.125s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Created reservations ['d86b1a04-4d36-4cd8-879c-6c87d1255fb2', '4488b192-2516-4619-86cc-91d9b931cff7', '62152c2f-5d11-4ddf-afee-74f4ae648a17', '03d90975-d5d1-4680-acba-2529f2c04436'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:15 devstack sudo[86426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:15 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:15 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313" returned: 0 in 1.433s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:15 devstack sudo[86438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313
Apr 13 20:30:15 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:15 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.db25a17a-0f56-4489-a493-cbdbee47e2d7" returned: 0 in 1.061s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-db25a17a-0f56-4489-a493-cbdbee47e2d7" released by "_delete_snapshot" :: held 4.338s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" released by "delete_snapshot" :: held 4.353s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:15 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Created reservations ['1a9832aa-6a2b-4d89-9200-80090e8e69d1', 'a4e1b98f-7acd-40ed-9a76-ac352779b5f8', '9b6c5c6d-7298-4b99-b1cc-45f63dacba11', '0a61e5c2-03ee-4aa9-8176-8b57c83a4bab'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:16 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Delete snapshot completed successfully.
Apr 13 20:30:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2e3ab0b7-f241-439b-80a1-f0344d8e7d02 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-db25a17a-0f56-4489-a493-cbdbee47e2d7-delete_snapshot" released by "delete_snapshot" :: held 4.756s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:16 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 1.382s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:16 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:16 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Deleted volume successfully.
Apr 13 20:30:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-431852f2-1bd4-4436-bf1a-4e00b0073bb0 tempest-ServerRescueNegativeTestJSON-561496567 None] Lock "cinder-b2e656e5-e9ed-4ad8-9b81-a3a25aac23fb-delete_volume" released by "delete_volume" :: held 3.998s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:16 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fe3e18e0-b2e9-4679-87da-6208f509c313" returned: 0 in 1.375s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Lock "cinder-quobyte-fe3e18e0-b2e9-4679-87da-6208f509c313" released by "delete_volume" :: held 2.934s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['0c769262-e9ba-4074-b378-898008a56b3c'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:17 devstack cinder-volume[82824]: WARNING cinder.quota [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1474982521 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1474982521, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Created reservations ['38a14c61-2732-492b-982d-180a78bd388d', 'b9359e38-0e27-4e78-a189-8af14bea6c78', '6ca34081-e91e-4011-8b94-244779a085a6', '00feaf77-2c47-4fd0-a622-287965cd98f2'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] Creating offline snapshot e08f0a96-6f3a-4727-a40e-38a00ec28795 of volume d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a395918-f30d-4f9d-bbfb-853ef9cd24b8]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:17 devstack sudo[86517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:30:17 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:17 devstack sudo[86521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:17 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:18 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 1.122s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:18 devstack sudo[86555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795 1G
Apr 13 20:30:18 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:18 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 1.338s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:18 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:18 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-18c8968b-76b7-4813-a273-5edf3c617a74 tempest-GroupSnapshotsTest-1575066988 None] Delete group completed successfully.
Apr 13 20:30:20 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795 1G" returned: 0 in 2.072s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:20 devstack sudo[86624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795
Apr 13 20:30:20 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:21 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795" returned: 0 in 0.738s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:21 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795 is being set with open permissions: ugo+rw
Apr 13 20:30:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:21 devstack sudo[86636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795
Apr 13 20:30:21 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:21 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795" returned: 0 in 0.684s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.829s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:22 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-68e10633-3c0b-42df-acf8-369b5058437a tempest-SnapshotsActionsTest-1405708669 None] Create snapshot completed successfully
Apr 13 20:30:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-e08f0a96-6f3a-4727-a40e-38a00ec28795-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-e08f0a96-6f3a-4727-a40e-38a00ec28795-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-quobyte-e08f0a96-6f3a-4727-a40e-38a00ec28795" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-e08f0a96-6f3a-4727-a40e-38a00ec28795" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Deleting offline snapshot e08f0a96-6f3a-4727-a40e-38a00ec28795 of volume d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:30:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] snapshot_file for this snap is: volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:30:22 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1594d6-6c83-4e5b-8b8d-fcf373d9ec4a]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:22 devstack sudo[86643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795
Apr 13 20:30:22 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:23 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f97d2210-da3f-4e87-9988-9479d7fdcf2f tempest-GroupSnapshotsV319Test-550611194 None] Group tempest-GroupSnapshotsV319Test-Group-2128818447: creating
Apr 13 20:30:23 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f97d2210-da3f-4e87-9988-9479d7fdcf2f tempest-GroupSnapshotsV319Test-550611194 None] Group tempest-GroupSnapshotsV319Test-Group-2128818447: created successfully
Apr 13 20:30:23 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f97d2210-da3f-4e87-9988-9479d7fdcf2f tempest-GroupSnapshotsV319Test-550611194 None] Create group completed successfully.
Apr 13 20:30:23 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-29012cae-8301-4215-ac41-c3965996a375 req-934a6206-e633-4d7f-b3bf-79ce90f10797 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Terminate volume connection completed successfully.
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-29012cae-8301-4215-ac41-c3965996a375 req-934a6206-e633-4d7f-b3bf-79ce90f10797 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Deleting attachment 392630ff-a904-4877-8d01-5e076a2e63b9. {{(pid=82824) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 20:30:23 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795" returned: 0 in 0.653s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42a2228-e8e5-4a76-a423-05e6c922b0b2]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:23 devstack sudo[86648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:30:23 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "cinder-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "cinder-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "cinder-quobyte-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "cinder-quobyte-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23ede52-c648-4b48-851b-f8f5d39e0792]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:23 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.523s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:23 devstack sudo[86654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795
Apr 13 20:30:23 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:23 devstack sudo[86653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e
Apr 13 20:30:23 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Flow 'volume_create_manager' (5a7baae3-9667-4bb4-9e49-66ff2995534b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c52b4c-d5d5-4aee-bfbb-c62e2502b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c52b4c-d5d5-4aee-bfbb-c62e2502b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1204090343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15a04e8b-9265-4d65-aef1-cccad37f0ae4,host='devstack@QuobyteHD#QuobyteHD',id=a6e76801-e2e3-4746-92d0-9e4ac7061e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d815d4914fb44a296a24557dd426a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:24Z,use_quota=True,user_id='509b0e1c93d4414fa6197b634b0adabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e80b55c0-c53b-4f89-b074-3089682d3103),volume_type_id=e80b55c0-c53b-4f89-b074-3089682d3103)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6d68b0-502d-428b-ad4e-0304170d356e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6d68b0-502d-428b-ad4e-0304170d356e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dbb841-2ccd-4277-9241-4213feb83b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dbb841-2ccd-4277-9241-4213feb83b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e76801-e2e3-4746-92d0-9e4ac7061e69', 'volume_name': 'volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1fe1a3-ff65-4d35-9727-369345cf9fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1fe1a3-ff65-4d35-9727-369345cf9fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea0ccbf-2fe7-4c7c-8ae9-3510bdd269aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:24 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Volume a6e76801-e2e3-4746-92d0-9e4ac7061e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69', 'volume_size': 1}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=15a04e8b-9265-4d65-aef1-cccad37f0ae4,created_at=2026-04-13T18:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1204090343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15a04e8b-9265-4d65-aef1-cccad37f0ae4,host='devstack@QuobyteHD#QuobyteHD',id=a6e76801-e2e3-4746-92d0-9e4ac7061e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d815d4914fb44a296a24557dd426a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:24Z,use_quota=True,user_id='509b0e1c93d4414fa6197b634b0adabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e80b55c0-c53b-4f89-b074-3089682d3103),volume_type_id=e80b55c0-c53b-4f89-b074-3089682d3103)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Creating volume a6e76801-e2e3-4746-92d0-9e4ac7061e69 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:30:24 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:24 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795" returned: 0 in 0.695s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:24 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:24 devstack sudo[86662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 1073741824
Apr 13 20:30:24 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" returned: 0 in 0.754s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:24 devstack sudo[86663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795
Apr 13 20:30:24 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:24 devstack sudo[86665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e
Apr 13 20:30:24 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:25 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.e08f0a96-6f3a-4727-a40e-38a00ec28795" returned: 0 in 0.553s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:25 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 1073741824" returned: 0 in 0.591s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-e08f0a96-6f3a-4727-a40e-38a00ec28795" released by "_delete_snapshot" :: held 2.508s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" released by "delete_snapshot" :: held 2.530s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:25 devstack sudo[86675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69
Apr 13 20:30:25 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Created reservations ['acd1d169-6b4e-4081-8054-e50bbd956ec1', '1baf546d-4e11-4431-8214-49ca50145252', 'cba3a6c2-ae5d-4683-815a-f769d6851e1d', '8b92425e-9286-489f-aa3d-da2074ee1fd5'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:25 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" returned: 1 in 0.731s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:25 devstack sudo[86678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e
Apr 13 20:30:25 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:25 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Delete snapshot completed successfully.
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5332fdde-7488-48ee-a93a-0ee6028a5885 tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-e08f0a96-6f3a-4727-a40e-38a00ec28795-delete_snapshot" released by "delete_snapshot" :: held 2.780s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:25 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69" returned: 0 in 0.545s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea0ccbf-2fe7-4c7c-8ae9-3510bdd269aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335b07da-09a2-4527-acaa-6388d87da33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:25 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Volume volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 (a6e76801-e2e3-4746-92d0-9e4ac7061e69): created successfully
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335b07da-09a2-4527-acaa-6388d87da33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Flow 'volume_create_manager' (5a7baae3-9667-4bb4-9e49-66ff2995534b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:25 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-78dd5a82-f3df-469a-9d0d-97680abd373e tempest-GroupSnapshotsV319Test-550611194 None] Created volume successfully.
Apr 13 20:30:25 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" returned: 0 in 0.508s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "cinder-quobyte-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e" released by "delete_volume" :: held 2.036s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.quota [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Created reservations ['a8ab801c-eb86-4f91-a08e-8b77bb041370', '28c251de-2b54-4644-bb8e-8c071f102a27', 'aa47d96b-6d18-4008-b187-051263c43df8', '729e7411-098b-431c-b40a-648a641b892a'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:26 devstack sudo[86682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:26 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:26 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] Creating offline snapshot 7acaecd0-7c61-4fc7-9003-0c53f489c5a3 of volume d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:30:26 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5469ed9-8428-465b-b3e0-b536fe39292e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:26 devstack sudo[86684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:30:26 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:26 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.497s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:26 devstack cinder-volume[82824]: DEBUG cinder.manager [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:26 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Deleted volume successfully.
Apr 13 20:30:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-29012cae-8301-4215-ac41-c3965996a375 req-b6f1249e-ab44-4fc5-a7f7-06ae9477e5dd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "cinder-b136e3da-1ff9-4877-b63a-48ab0b6dfb0e-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:26 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.720s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:26 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:26 devstack sudo[86724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3 1G
Apr 13 20:30:26 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:26 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] GroupSnapshot a194a06f-f07a-4a4d-9944-82a58cfdf0ed: creating.
Apr 13 20:30:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] Group snapshot a194a06f-f07a-4a4d-9944-82a58cfdf0ed: creating. {{(pid=82824) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 20:30:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:27 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3 1G" returned: 0 in 0.550s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:27 devstack sudo[86734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3
Apr 13 20:30:27 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:27 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3" returned: 0 in 0.492s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:27 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3 is being set with open permissions: ugo+rw
Apr 13 20:30:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:27 devstack sudo[86748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3
Apr 13 20:30:27 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:28 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3" returned: 0 in 0.543s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.451s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] Creating offline snapshot b7640193-aa50-492d-a013-c168c1d9bcc9 of volume a6e76801-e2e3-4746-92d0-9e4ac7061e69 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:30:28 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-9440a0cf-81a7-4bba-80d0-1c65db424d0b tempest-SnapshotsActionsTest-1405708669 None] Create snapshot completed successfully
Apr 13 20:30:28 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[9985ea36-59cf-4e76-a056-2b575d9c1603]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:28 devstack sudo[86776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69
Apr 13 20:30:28 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:29 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69" returned: 0 in 0.499s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:29 devstack sudo[86786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9 1G
Apr 13 20:30:29 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-7acaecd0-7c61-4fc7-9003-0c53f489c5a3-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-7acaecd0-7c61-4fc7-9003-0c53f489c5a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Acquiring lock "cinder-quobyte-7acaecd0-7c61-4fc7-9003-0c53f489c5a3" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-7acaecd0-7c61-4fc7-9003-0c53f489c5a3" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Deleting offline snapshot 7acaecd0-7c61-4fc7-9003-0c53f489c5a3 of volume d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] snapshot_file for this snap is: volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93589bf-692f-495e-94c8-f6dc4cb439fb]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:29 devstack sudo[86790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3
Apr 13 20:30:29 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:29 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9 1G" returned: 0 in 0.574s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:29 devstack sudo[86796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9
Apr 13 20:30:29 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:29 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3" returned: 0 in 0.570s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25e03dc-7eed-4bac-ad0e-777547574b07]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:30 devstack sudo[86802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:30:30 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:30 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9" returned: 0 in 0.454s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:30 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:30:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:30 devstack sudo[86806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9
Apr 13 20:30:30 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:30 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.515s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:30 devstack sudo[86813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3
Apr 13 20:30:30 devstack sudo[86813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:30 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9" returned: 0 in 0.464s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:30 devstack sudo[86815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.info
Apr 13 20:30:30 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:30 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:30 devstack sudo[86813]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3" returned: 0 in 0.497s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.info" returned: 0 in 0.425s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:30 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:30:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:30 devstack sudo[86821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3
Apr 13 20:30:30 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:30 devstack sudo[86822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.info
Apr 13 20:30:30 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:31 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.7acaecd0-7c61-4fc7-9003-0c53f489c5a3" returned: 0 in 0.420s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-7acaecd0-7c61-4fc7-9003-0c53f489c5a3" released by "_delete_snapshot" :: held 2.052s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" released by "delete_snapshot" :: held 2.062s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:31 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.info" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.967s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:31 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Created reservations ['816ff415-def9-4b65-a0f9-a1fae964165f', '1d1eb46a-6fa3-40fc-a214-4df451d7a112', 'a92647fa-5bdb-4544-85ed-6f5eacfc6bc0', '3af18dc6-8467-4522-9fc5-18d7d6f7fad0'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6e86bc3d-8819-479f-9425-d649dc3c0007 tempest-GroupSnapshotsV319Test-550611194 None] group_snapshot a194a06f-f07a-4a4d-9944-82a58cfdf0ed: created successfully
Apr 13 20:30:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Delete snapshot completed successfully.
Apr 13 20:30:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2be6c5-0abd-4663-8780-320344133c6f tempest-SnapshotsActionsTest-573052653 None] Lock "cinder-7acaecd0-7c61-4fc7-9003-0c53f489c5a3-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:32 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] group_snapshot a194a06f-f07a-4a4d-9944-82a58cfdf0ed: deleting
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] group_snapshot a194a06f-f07a-4a4d-9944-82a58cfdf0ed: deleting {{(pid=82824) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Acquiring lock "cinder-quobyte-a6e76801-e2e3-4746-92d0-9e4ac7061e69" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Lock "cinder-quobyte-a6e76801-e2e3-4746-92d0-9e4ac7061e69" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Acquiring lock "cinder-quobyte-b7640193-aa50-492d-a013-c168c1d9bcc9" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Lock "cinder-quobyte-b7640193-aa50-492d-a013-c168c1d9bcc9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Deleting offline snapshot b7640193-aa50-492d-a013-c168c1d9bcc9 of volume a6e76801-e2e3-4746-92d0-9e4ac7061e69 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] snapshot_file for this snap is: volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1da2b0-8a59-49be-80aa-3ed296c7cc9b]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:32 devstack sudo[86828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9
Apr 13 20:30:32 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "cinder-93465b58-9038-4336-ad50-b7b0fe3c0bbb-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Lock "cinder-93465b58-9038-4336-ad50-b7b0fe3c0bbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "cinder-quobyte-93465b58-9038-4336-ad50-b7b0fe3c0bbb" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Lock "cinder-quobyte-93465b58-9038-4336-ad50-b7b0fe3c0bbb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Deleting offline snapshot 93465b58-9038-4336-ad50-b7b0fe3c0bbb of volume d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] snapshot_file for this snap is: volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf34d25e-c9c9-479d-9d6f-1b9a20c032ef]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:32 devstack sudo[86830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:30:32 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:33 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9" returned: 0 in 0.667s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:33 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d715d7a-3bfb-4c20-b965-8bf9a0f1ef08]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:33 devstack sudo[86836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69
Apr 13 20:30:33 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:33 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.623s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:33 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d0ff69-be49-42ca-b9c9-b167172af663]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:33 devstack sudo[86841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935
Apr 13 20:30:33 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:33 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69" returned: 0 in 0.514s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:33 devstack sudo[86846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9
Apr 13 20:30:33 devstack sudo[86846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:34 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935" returned: 0 in 0.607s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:34 devstack sudo[86853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:30:34 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:34 devstack sudo[86846]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9" returned: 0 in 0.542s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:34 devstack sudo[86858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9
Apr 13 20:30:34 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:34 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.621s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:34 devstack sudo[86863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb
Apr 13 20:30:34 devstack sudo[86863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:34 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69.b7640193-aa50-492d-a013-c168c1d9bcc9" returned: 0 in 0.638s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Lock "cinder-quobyte-b7640193-aa50-492d-a013-c168c1d9bcc9" released by "_delete_snapshot" :: held 2.447s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Lock "cinder-quobyte-a6e76801-e2e3-4746-92d0-9e4ac7061e69" released by "delete_snapshot" :: held 2.459s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:35 devstack cinder-volume[82824]: WARNING cinder.quota [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-143382615 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-143382615, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:30:35 devstack cinder-volume[82824]: WARNING cinder.quota [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-143382615 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-143382615, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:30:35 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] Created reservations ['c1d3bcbc-863c-4274-a091-0d1fc79bb3ce', 'd4bdacae-6c49-44f8-bc9b-0126f3063610', '01a733cf-8a90-4580-9ce0-80ab02106673', '5304720e-5d95-4961-8e61-66d30c74fdcb'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:35 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c2625fe4-82a4-419a-9997-f241218393fc tempest-GroupSnapshotsV319Test-550611194 None] group_snapshot a194a06f-f07a-4a4d-9944-82a58cfdf0ed: deleted successfully
Apr 13 20:30:35 devstack sudo[86863]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935.93465b58-9038-4336-ad50-b7b0fe3c0bbb" returned: 0 in 0.534s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Lock "cinder-quobyte-93465b58-9038-4336-ad50-b7b0fe3c0bbb" released by "_delete_snapshot" :: held 2.468s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" released by "delete_snapshot" :: held 2.485s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:35 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Created reservations ['9e1fe873-a9ea-4877-a176-50ee91fcae37', '13c1460d-6e41-4aef-b9da-f50684738ba0', 'fce8fe77-128f-461b-a87b-976eef31e40d', 'f7d5285f-0ac7-4d47-9afb-b75d0f49b973'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:35 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Delete snapshot completed successfully.
Apr 13 20:30:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6158466f-0ea5-4886-8448-9a2e1ddb51b1 tempest-SnapshotsActionsTest-1405708669 None] Lock "cinder-93465b58-9038-4336-ad50-b7b0fe3c0bbb-delete_snapshot" released by "delete_snapshot" :: held 2.588s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Acquiring lock "cinder-quobyte-a6e76801-e2e3-4746-92d0-9e4ac7061e69" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Lock "cinder-quobyte-a6e76801-e2e3-4746-92d0-9e4ac7061e69" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:35 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2e0980-19ab-4b8c-8a17-7ee0f16aef70]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:36 devstack sudo[86880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69
Apr 13 20:30:36 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "cinder-d6e7cb60-933a-46d9-8aa8-daac16bdb935-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Lock "cinder-d6e7cb60-933a-46d9-8aa8-daac16bdb935-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee74554-7b72-48eb-9463-f2360e49cf39]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:36 devstack sudo[86900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935
Apr 13 20:30:36 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Flow 'volume_create_manager' (b419abf5-59a8-4d58-88c0-ff1705633945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac2082d-4680-4bca-9f86-500daa7f455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac2082d-4680-4bca-9f86-500daa7f455f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1905024353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cabb66208341a080440c6251cb2b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:36Z,use_quota=True,user_id='42a0138590c747629b931de11c25a181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89985f9-9527-4338-81b2-30f0bca6a024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89985f9-9527-4338-81b2-30f0bca6a024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5ca2e7-8547-49a5-9dea-8dc0d49d0253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5ca2e7-8547-49a5-9dea-8dc0d49d0253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b', 'volume_name': 'volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf82b74-d1b4-4bbc-ae10-d7b2424f2dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf82b74-d1b4-4bbc-ae10-d7b2424f2dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba466e5c-6b5b-4dd7-8655-bfe897482546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:36 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Volume 25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b', 'volume_size': 1}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1905024353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cabb66208341a080440c6251cb2b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:36Z,use_quota=True,user_id='42a0138590c747629b931de11c25a181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Creating volume 25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:30:36 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:36 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-a96cb00f-c597-4b26-99c5-90434406afd1 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Terminate volume connection completed successfully.
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-a96cb00f-c597-4b26-99c5-90434406afd1 tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Deleting attachment 03fd80bd-703c-4dbb-a39b-bfee967001a1. {{(pid=82824) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 20:30:36 devstack sudo[86907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b 1073741824
Apr 13 20:30:36 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:36 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69" returned: 0 in 0.668s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:36 devstack sudo[86909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69
Apr 13 20:30:36 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:36 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935" returned: 0 in 0.618s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:36 devstack sudo[86914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935
Apr 13 20:30:36 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "cinder-c11c634d-04c9-4fa0-9927-9f9f3e891a20-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "cinder-c11c634d-04c9-4fa0-9927-9f9f3e891a20-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:37 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a6e76801-e2e3-4746-92d0-9e4ac7061e69" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Lock "cinder-quobyte-a6e76801-e2e3-4746-92d0-9e4ac7061e69" released by "delete_volume" :: held 1.210s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:37 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "cinder-quobyte-c11c634d-04c9-4fa0-9927-9f9f3e891a20" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b 1073741824" returned: 0 in 0.590s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "cinder-quobyte-c11c634d-04c9-4fa0-9927-9f9f3e891a20" acquired by "delete_volume" :: waited 0.017s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[280888df-a424-4862-9fa9-43b8aa563ea3]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Created reservations ['fda55c16-b02d-4a04-9266-297478c91cb6'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:37 devstack cinder-volume[82824]: WARNING cinder.quota [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-143382615 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-143382615, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:30:37 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b
Apr 13 20:30:37 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:37 devstack sudo[86921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20
Apr 13 20:30:37 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Created reservations ['7480a44e-1ae8-43d4-9c51-6a8f29281da4', '9a0ff4c9-2ffa-4300-9232-bb0cc02d6eb0', '4345ce3b-3285-4a5b-b240-884bd9461c79', '433e6c07-65da-4a1e-9d79-b5c8030a6de0'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:37 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:37 devstack sudo[86926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:37 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d6e7cb60-933a-46d9-8aa8-daac16bdb935" returned: 0 in 0.518s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Lock "cinder-quobyte-d6e7cb60-933a-46d9-8aa8-daac16bdb935" released by "delete_volume" :: held 1.179s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Created reservations ['12e82758-23ce-4d22-bdfb-c680129f0b0f', '5222826c-f382-46d0-810d-80db2e2d2991', 'c4617093-4d0a-48d9-8eec-545e9af201cd', '8625b52f-f205-4cae-9e1f-aaa8a9b0b483'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:37 devstack sudo[86928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:37 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:37 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b" returned: 0 in 0.684s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba466e5c-6b5b-4dd7-8655-bfe897482546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd9e735-0309-42b8-aa35-ed0a245edf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:37 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Volume volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b (25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b): created successfully
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd9e735-0309-42b8-aa35-ed0a245edf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Flow 'volume_create_manager' (b419abf5-59a8-4d58-88c0-ff1705633945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:38 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-61b2430e-d86a-4440-bd01-39d50fa43e94 req-24c8b8de-ee21-4beb-bb45-289536f8b9e6 tempest-VolumesSnapshotsTestJSON-1006127462 None] Created volume successfully.
Apr 13 20:30:38 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20" returned: 0 in 0.809s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:38 devstack sudo[86938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20
Apr 13 20:30:38 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:38 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.680s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:38 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2c67ab1b-d5f5-4c56-bcc1-bb8708e6c971 tempest-GroupSnapshotsV319Test-550611194 None] Delete group completed successfully.
Apr 13 20:30:38 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.599s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:38 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Deleted volume successfully.
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cb37f13d-1686-405a-a658-13d9289e9771 tempest-SnapshotsActionsTest-1405708669 None] Lock "cinder-d6e7cb60-933a-46d9-8aa8-daac16bdb935-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:38 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c11c634d-04c9-4fa0-9927-9f9f3e891a20" returned: 0 in 0.504s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "cinder-quobyte-c11c634d-04c9-4fa0-9927-9f9f3e891a20" released by "delete_volume" :: held 1.342s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG cinder.quota [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Created reservations ['830af233-164b-41d9-b6d9-f556ea43e5ef', '23cf74aa-334c-460a-ba1e-83f78a142099', 'fdf0b009-3436-4ef2-be12-2edc15f0ab1c', 'b4ab7d4c-8cf4-40ef-8ead-01b7b716b5a4'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:38 devstack sudo[86941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:38 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] Creating offline snapshot 81a39a7a-9a00-49b1-97c4-c0e53b7ab207 of volume 25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:30:39 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[2428dbf9-d02b-4ce7-be79-a2fbb94722bb]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:39 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.526s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:39 devstack cinder-volume[82824]: DEBUG cinder.manager [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:39 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Deleted volume successfully.
Apr 13 20:30:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-6ec9536e-59aa-45f9-aa71-e2e9211f0beb req-38f15629-6cf3-4dd9-8731-0e340aefccfd tempest-ServerBootFromVolumeStableRescueTest-890524183 None] Lock "cinder-c11c634d-04c9-4fa0-9927-9f9f3e891a20-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:39 devstack sudo[86944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b
Apr 13 20:30:39 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:39 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b" returned: 0 in 0.662s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:39 devstack sudo[86950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207 1G
Apr 13 20:30:39 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:40 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207 1G" returned: 0 in 0.568s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:40 devstack sudo[86955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207
Apr 13 20:30:40 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:40 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207" returned: 0 in 0.504s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:40 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207 is being set with open permissions: ugo+rw
Apr 13 20:30:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:40 devstack sudo[86960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207
Apr 13 20:30:40 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:41 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207" returned: 0 in 0.533s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:41 devstack sudo[86963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.info
Apr 13 20:30:41 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:41 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.info" returned: 0 in 0.531s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:41 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.info is being set with open permissions: ugo+rw
Apr 13 20:30:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-9c5a0c01-88ed-4317-a480-f6eafbc2b5ae tempest-GroupsTest-949575412 None] Group tempest-Group1-1682509502: creating
Apr 13 20:30:41 devstack sudo[86966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.info
Apr 13 20:30:41 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-9c5a0c01-88ed-4317-a480-f6eafbc2b5ae tempest-GroupsTest-949575412 None] Group tempest-Group1-1682509502: created successfully
Apr 13 20:30:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-9c5a0c01-88ed-4317-a480-f6eafbc2b5ae tempest-GroupsTest-949575412 None] Create group completed successfully.
Apr 13 20:30:42 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.info" returned: 0 in 0.454s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.327s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:42 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-46027975-4ba8-49c7-b4da-f1469da5afb2 req-5b9d1f6f-1544-48a2-928f-ac461fa7143d tempest-VolumesSnapshotsTestJSON-1006127462 None] Create snapshot completed successfully
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Acquiring lock "cinder-81a39a7a-9a00-49b1-97c4-c0e53b7ab207-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "cinder-81a39a7a-9a00-49b1-97c4-c0e53b7ab207-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Acquiring lock "cinder-quobyte-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "cinder-quobyte-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Acquiring lock "cinder-quobyte-81a39a7a-9a00-49b1-97c4-c0e53b7ab207" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "cinder-quobyte-81a39a7a-9a00-49b1-97c4-c0e53b7ab207" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Deleting offline snapshot 81a39a7a-9a00-49b1-97c4-c0e53b7ab207 of volume 25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] snapshot_file for this snap is: volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ba281d-54c2-4ae4-a72a-c194adfbf716]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:42 devstack sudo[86969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207
Apr 13 20:30:42 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:43 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a41b82ec-2dfc-4bd5-9bf8-6ce1d6b9cea5 tempest-GroupsTest-949575412 None] Group tempest-Group2-918449922: creating
Apr 13 20:30:43 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a41b82ec-2dfc-4bd5-9bf8-6ce1d6b9cea5 tempest-GroupsTest-949575412 None] Group tempest-Group2-918449922: created successfully
Apr 13 20:30:43 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a41b82ec-2dfc-4bd5-9bf8-6ce1d6b9cea5 tempest-GroupsTest-949575412 None] Create group completed successfully.
Apr 13 20:30:43 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207" returned: 0 in 0.539s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:30:43 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d78f1e-4d51-42e6-b9fa-32fc558c09b5]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:43 devstack sudo[86977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b
Apr 13 20:30:43 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:43 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b" returned: 0 in 0.605s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:43 devstack sudo[86982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207
Apr 13 20:30:43 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:44 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207" returned: 0 in 0.544s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:44 devstack sudo[86987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207
Apr 13 20:30:44 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Flow 'volume_create_manager' (3c741c35-ef75-4c9a-bed5-c99246e808a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b460dfc8-4f55-49a8-bb8c-849d39cb03e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b460dfc8-4f55-49a8-bb8c-849d39cb03e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1852470078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4c43831d-a88e-476b-8d66-b1d1c880385d,host='devstack@QuobyteHD#QuobyteHD',id=927dff67-8d04-43ac-b928-c52c2db9d3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbbb04ab187439bbc346f7264164f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:44Z,use_quota=True,user_id='7b3e8a84ece944dc822bfed0986d310f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c164e513-f724-4f11-be58-7d4594a2b3f1),volume_type_id=c164e513-f724-4f11-be58-7d4594a2b3f1)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7a2030-a623-4e3b-8f1d-e70922fde351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7a2030-a623-4e3b-8f1d-e70922fde351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608be725-3c53-4294-8e7f-39d5e8f9b58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608be725-3c53-4294-8e7f-39d5e8f9b58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '927dff67-8d04-43ac-b928-c52c2db9d3ec', 'volume_name': 'volume-927dff67-8d04-43ac-b928-c52c2db9d3ec', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c8dffd-af5a-4d5f-86d1-7d391417fbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c8dffd-af5a-4d5f-86d1-7d391417fbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbd4dde-4edb-4943-a36b-27f1b2920584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:44 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Volume 927dff67-8d04-43ac-b928-c52c2db9d3ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-927dff67-8d04-43ac-b928-c52c2db9d3ec', 'volume_size': 1}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4c43831d-a88e-476b-8d66-b1d1c880385d,created_at=2026-04-13T18:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1852470078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4c43831d-a88e-476b-8d66-b1d1c880385d,host='devstack@QuobyteHD#QuobyteHD',id=927dff67-8d04-43ac-b928-c52c2db9d3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbbb04ab187439bbc346f7264164f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:44Z,use_quota=True,user_id='7b3e8a84ece944dc822bfed0986d310f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c164e513-f724-4f11-be58-7d4594a2b3f1),volume_type_id=c164e513-f724-4f11-be58-7d4594a2b3f1)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Creating volume 927dff67-8d04-43ac-b928-c52c2db9d3ec {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:30:44 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:44 devstack sudo[86991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec 1073741824
Apr 13 20:30:44 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:44 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b.81a39a7a-9a00-49b1-97c4-c0e53b7ab207" returned: 0 in 0.506s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "cinder-quobyte-81a39a7a-9a00-49b1-97c4-c0e53b7ab207" released by "_delete_snapshot" :: held 2.282s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "cinder-quobyte-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b" released by "delete_snapshot" :: held 2.314s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:44 devstack cinder-volume[82824]: DEBUG cinder.quota [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Created reservations ['907592c6-dfc5-4d9c-932b-6965a766b189', 'a5e8d3d7-976e-4a29-9446-8219cb53ae6b', 'a4a03e5d-ca80-4023-bff5-92c85f53d5d3', '7529af77-3534-4903-8c88-a0477e0e89ef'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:45 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Delete snapshot completed successfully.
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-fa4a2979-7c77-409a-b9ae-04d1d50893f9 req-84dd53b1-b414-4507-b69e-11ec516312a5 tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "cinder-81a39a7a-9a00-49b1-97c4-c0e53b7ab207-delete_snapshot" released by "delete_snapshot" :: held 2.466s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:45 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec 1073741824" returned: 0 in 0.604s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:45 devstack sudo[86997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec
Apr 13 20:30:45 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:45 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec" returned: 0 in 0.478s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbd4dde-4edb-4943-a36b-27f1b2920584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-927dff67-8d04-43ac-b928-c52c2db9d3ec', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68df0e2-bb63-42c3-8ca7-071dc7b1e64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:45 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Volume volume-927dff67-8d04-43ac-b928-c52c2db9d3ec (927dff67-8d04-43ac-b928-c52c2db9d3ec): created successfully
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68df0e2-bb63-42c3-8ca7-071dc7b1e64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Flow 'volume_create_manager' (3c741c35-ef75-4c9a-bed5-c99246e808a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:45 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-bc0bb831-7730-455b-a62f-6177890a1ad3 tempest-GroupsTest-949575412 None] Created volume successfully.
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Acquiring lock "cinder-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "cinder-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Acquiring lock "cinder-quobyte-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "cinder-quobyte-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b" acquired by "delete_volume" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[def54aec-3a34-454e-8acc-ded8cf10ff03]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:46 devstack sudo[87000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b
Apr 13 20:30:46 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:46 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b" returned: 0 in 0.591s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:46 devstack sudo[87005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b
Apr 13 20:30:46 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Flow 'volume_create_manager' (5e38882d-f2aa-462b-86f8-7cb85bb2e160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de589c9-5362-4db0-acc3-d8a7163e1f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de589c9-5362-4db0-acc3-d8a7163e1f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2063751647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9347000d-a672-4cd6-ae1a-a6ed684a5c5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c14663b9eb14ba18d57606a32e9d1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:47Z,use_quota=True,user_id='74cc4f02b78a4db6b8c0e40c64309258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c7bbd3-39f3-4080-aa38-4bdfe3f193ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c7bbd3-39f3-4080-aa38-4bdfe3f193ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5711d83a-6d6d-445a-8276-41e4ec12910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5711d83a-6d6d-445a-8276-41e4ec12910c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9347000d-a672-4cd6-ae1a-a6ed684a5c5d', 'volume_name': 'volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4b2bf6-eb25-4f1f-89b1-f9bac9f3d5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4b2bf6-eb25-4f1f-89b1-f9bac9f3d5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6f94bf-a1ed-496f-8422-2dc7e5924efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:46 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Volume 9347000d-a672-4cd6-ae1a-a6ed684a5c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d', 'volume_size': 1}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2063751647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9347000d-a672-4cd6-ae1a-a6ed684a5c5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c14663b9eb14ba18d57606a32e9d1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:47Z,use_quota=True,user_id='74cc4f02b78a4db6b8c0e40c64309258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Creating volume 9347000d-a672-4cd6-ae1a-a6ed684a5c5d {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:30:46 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:30:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:46 devstack sudo[87007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d 1073741824
Apr 13 20:30:46 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Acquiring lock "cinder-quobyte-927dff67-8d04-43ac-b928-c52c2db9d3ec" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Lock "cinder-quobyte-927dff67-8d04-43ac-b928-c52c2db9d3ec" acquired by "delete_volume" :: waited 0.026s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21f01f9-5f96-4779-aef7-78fb512f1105]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:47 devstack sudo[87010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec
Apr 13 20:30:47 devstack sudo[87010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:47 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b" returned: 0 in 0.626s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "cinder-quobyte-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b" released by "delete_volume" :: held 1.269s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.quota [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Created reservations ['f525c736-d88a-4577-b86d-eee4d1d988bd', 'e75b507a-fb7d-43e7-a75f-6cbb0bbf3926', 'a2187b48-9644-477f-86fc-a0eb3338ddec', '10762188-8e5e-4815-8c39-ee28da445b73'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:47 devstack sudo[87014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:47 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:47 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d 1073741824" returned: 0 in 0.591s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:47 devstack sudo[87017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d
Apr 13 20:30:47 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:47 devstack sudo[87010]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec" returned: 0 in 0.525s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:47 devstack sudo[87022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec
Apr 13 20:30:47 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:47 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.512s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.manager [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:47 devstack cinder-volume[82824]: INFO cinder.volume.manager [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Deleted volume successfully.
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [req-30ea43c6-fed2-4d4f-9384-fe5373c869c7 req-671aa98d-818d-4124-92de-3c97c2fa0a7f tempest-VolumesSnapshotsTestJSON-1006127462 None] Lock "cinder-25ffdd65-3c05-4f0d-a2f1-e0f3fdc53d3b-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:47 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d" returned: 0 in 0.463s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6f94bf-a1ed-496f-8422-2dc7e5924efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847987d9-378c-46f2-a927-18f0848df0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:47 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Volume volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d (9347000d-a672-4cd6-ae1a-a6ed684a5c5d): created successfully
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847987d9-378c-46f2-a927-18f0848df0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Flow 'volume_create_manager' (5e38882d-f2aa-462b-86f8-7cb85bb2e160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:47 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3ba92a96-a832-40f3-a2c0-c2de5c5c4120 tempest-VolumesTestJSON-2133221849 None] Created volume successfully.
Apr 13 20:30:48 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-927dff67-8d04-43ac-b928-c52c2db9d3ec" returned: 0 in 0.532s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Lock "cinder-quobyte-927dff67-8d04-43ac-b928-c52c2db9d3ec" released by "delete_volume" :: held 1.088s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Created reservations ['1345f213-cfd1-4ae9-8288-6402836fe5ec'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:48 devstack cinder-volume[82824]: WARNING cinder.quota [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-501752737 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-501752737, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:30:48 devstack cinder-volume[82824]: WARNING cinder.quota [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-501752737 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-501752737, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Created reservations ['250b47dd-26ae-4777-a1a2-2f98078fd44d', 'd2c7fc2d-f1fe-483d-999f-359a9d82c14e', 'a923fc51-7db5-4965-899e-cf06e91b0f8d', '6eddedfe-35c4-4d5f-96c5-6fd6c1d0a8a4'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:48 devstack sudo[87027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:48 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:48 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.480s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:48 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:48 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-56564454-f548-4117-b5da-d2f02061acc3 tempest-GroupsTest-949575412 None] Delete group completed successfully.
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Flow 'volume_create_manager' (4ffc599d-00d5-4979-9eb9-992cb4f5383f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b332ec9b-1f97-47bf-82ad-7111c4be5dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b332ec9b-1f97-47bf-82ad-7111c4be5dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1825475494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d55aae9-6b2d-4043-8217-57019903ec3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c14663b9eb14ba18d57606a32e9d1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:49Z,use_quota=True,user_id='74cc4f02b78a4db6b8c0e40c64309258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383c1f21-a2f5-41c0-a19c-c2dae6e6958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383c1f21-a2f5-41c0-a19c-c2dae6e6958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa8843b-aa35-4ded-8e58-69aae6da02b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa8843b-aa35-4ded-8e58-69aae6da02b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d55aae9-6b2d-4043-8217-57019903ec3e', 'volume_name': 'volume-7d55aae9-6b2d-4043-8217-57019903ec3e', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aadcc65-bd2a-4b08-87fd-ed0adbc4e0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aadcc65-bd2a-4b08-87fd-ed0adbc4e0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6746d2c5-4d41-4e19-a74d-f22e73a466ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:49 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Volume 7d55aae9-6b2d-4043-8217-57019903ec3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d55aae9-6b2d-4043-8217-57019903ec3e', 'volume_size': 1}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1825475494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d55aae9-6b2d-4043-8217-57019903ec3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c14663b9eb14ba18d57606a32e9d1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:49Z,use_quota=True,user_id='74cc4f02b78a4db6b8c0e40c64309258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Creating volume 7d55aae9-6b2d-4043-8217-57019903ec3e {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:30:49 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:49 devstack sudo[87031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e 1073741824
Apr 13 20:30:49 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Flow 'volume_create_manager' (7e6ea547-4865-4386-992e-bc89a4acf45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae35f398-3e83-4735-912f-11d534363b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae35f398-3e83-4735-912f-11d534363b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2038490475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07101cae-6a8e-49f1-b24b-dbe9ab792b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c96fd676ae843818e401408088c295a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:49Z,use_quota=True,user_id='08cc0c4b52af40978385b98778fd7639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250a2e4-8c09-48a0-a4ae-474dd3d457d5),volume_type_id=9250a2e4-8c09-48a0-a4ae-474dd3d457d5)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f14e62-bfb1-40b7-9154-7393cd7e969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f14e62-bfb1-40b7-9154-7393cd7e969e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6ac86f-db94-4e39-a3ea-9110a1f3f6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6ac86f-db94-4e39-a3ea-9110a1f3f6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07101cae-6a8e-49f1-b24b-dbe9ab792b98', 'volume_name': 'volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f8d733-7326-4068-8d02-37103b63c75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f8d733-7326-4068-8d02-37103b63c75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776aad7d-2e35-4c83-b85e-547f0854313f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:49 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Volume 07101cae-6a8e-49f1-b24b-dbe9ab792b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98', 'volume_size': 1}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-56f90146-59c7-417d-a115-c2edf76fab39 tempest-GroupsTest-949575412 None] Created reservations ['e8bb4cbc-4e29-493e-97af-1ee5bacd452b'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56f90146-59c7-417d-a115-c2edf76fab39 tempest-GroupsTest-949575412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56f90146-59c7-417d-a115-c2edf76fab39 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-56f90146-59c7-417d-a115-c2edf76fab39 tempest-GroupsTest-949575412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-56f90146-59c7-417d-a115-c2edf76fab39 tempest-GroupsTest-949575412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56f90146-59c7-417d-a115-c2edf76fab39 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56f90146-59c7-417d-a115-c2edf76fab39 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:49 devstack sudo[87033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:49 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:49 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e 1073741824" returned: 0 in 0.590s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:50 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:50 devstack sudo[87039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56f90146-59c7-417d-a115-c2edf76fab39 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.466s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:50 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-56f90146-59c7-417d-a115-c2edf76fab39 tempest-GroupsTest-949575412 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:50 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-56f90146-59c7-417d-a115-c2edf76fab39 tempest-GroupsTest-949575412 None] Delete group completed successfully.
Apr 13 20:30:50 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e" returned: 0 in 0.532s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.031s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2038490475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07101cae-6a8e-49f1-b24b-dbe9ab792b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c96fd676ae843818e401408088c295a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:49Z,use_quota=True,user_id='08cc0c4b52af40978385b98778fd7639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9250a2e4-8c09-48a0-a4ae-474dd3d457d5),volume_type_id=9250a2e4-8c09-48a0-a4ae-474dd3d457d5)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Creating volume 07101cae-6a8e-49f1-b24b-dbe9ab792b98 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:30:50 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6746d2c5-4d41-4e19-a74d-f22e73a466ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d55aae9-6b2d-4043-8217-57019903ec3e', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:50 devstack sudo[87042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98 1073741824
Apr 13 20:30:50 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79c4e2c-a0af-4427-a120-f4c275691669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:50 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Volume volume-7d55aae9-6b2d-4043-8217-57019903ec3e (7d55aae9-6b2d-4043-8217-57019903ec3e): created successfully
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79c4e2c-a0af-4427-a120-f4c275691669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Flow 'volume_create_manager' (4ffc599d-00d5-4979-9eb9-992cb4f5383f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:50 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-14b635cc-345b-4ba4-a4b3-6dac2e6c15c3 tempest-VolumesTestJSON-2133221849 None] Created volume successfully.
Apr 13 20:30:50 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-fa8a8275-ce37-4a15-bbb0-0462642a083b tempest-GroupsTest-949575412 None] Group tempest-GroupsTest-Group-65409446: creating
Apr 13 20:30:50 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-fa8a8275-ce37-4a15-bbb0-0462642a083b tempest-GroupsTest-949575412 None] Group tempest-GroupsTest-Group-65409446: created successfully
Apr 13 20:30:50 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-fa8a8275-ce37-4a15-bbb0-0462642a083b tempest-GroupsTest-949575412 None] Create group completed successfully.
Apr 13 20:30:51 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98 1073741824" returned: 0 in 0.546s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:51 devstack sudo[87047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98
Apr 13 20:30:51 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:51 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98" returned: 0 in 0.502s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776aad7d-2e35-4c83-b85e-547f0854313f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55b7d32-d39d-4679-b4c1-699f89ef6a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:51 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Volume volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98 (07101cae-6a8e-49f1-b24b-dbe9ab792b98): created successfully
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55b7d32-d39d-4679-b4c1-699f89ef6a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Flow 'volume_create_manager' (7e6ea547-4865-4386-992e-bc89a4acf45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:51 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-88d4b8b4-a4ff-47f7-804e-6c4f41617b4b tempest-VolumeTypesAccessTest-33909653 None] Created volume successfully.
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Flow 'volume_create_manager' (1a779f9c-1bc8-4539-bdee-e28f294ccb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b43506-ee50-4472-b4f1-5b5fa24f9457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b43506-ee50-4472-b4f1-5b5fa24f9457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1117734487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4823a2c2-24c9-4f67-ac86-d73a78576ee2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c14663b9eb14ba18d57606a32e9d1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:52Z,use_quota=True,user_id='74cc4f02b78a4db6b8c0e40c64309258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9580cd-d086-4faa-ae60-24a7385c56e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9580cd-d086-4faa-ae60-24a7385c56e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa7ce79-8fe3-42d2-bf9d-e11a6cd07cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa7ce79-8fe3-42d2-bf9d-e11a6cd07cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4823a2c2-24c9-4f67-ac86-d73a78576ee2', 'volume_name': 'volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5035ee-9fdd-47bf-818b-b5cded5e5b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5035ee-9fdd-47bf-818b-b5cded5e5b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611e93db-42af-4202-b140-f70d9999886f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:51 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Volume 4823a2c2-24c9-4f67-ac86-d73a78576ee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2', 'volume_size': 1}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1117734487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4823a2c2-24c9-4f67-ac86-d73a78576ee2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c14663b9eb14ba18d57606a32e9d1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:52Z,use_quota=True,user_id='74cc4f02b78a4db6b8c0e40c64309258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Creating volume 4823a2c2-24c9-4f67-ac86-d73a78576ee2 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:30:51 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:30:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:51 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2 1073741824
Apr 13 20:30:51 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Flow 'volume_create_manager' (0bbc1889-9a84-4b5e-af74-fc760be55ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8499740b-64a4-4234-9f57-cb8ea0e9b0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8499740b-64a4-4234-9f57-cb8ea0e9b0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1359168531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a0b15636-6500-4f63-a658-07dc73a8c47c,host='devstack@QuobyteHD#QuobyteHD',id=ac17b226-3948-49c7-b775-602b73f3a949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbbb04ab187439bbc346f7264164f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:52Z,use_quota=True,user_id='7b3e8a84ece944dc822bfed0986d310f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b87581ce-5857-4c6a-99d0-0ebd655fd786),volume_type_id=b87581ce-5857-4c6a-99d0-0ebd655fd786)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd60e2d-84aa-4045-bbb5-3b547396380a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd60e2d-84aa-4045-bbb5-3b547396380a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfe9462-8a44-49cc-b1a0-76505019468b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfe9462-8a44-49cc-b1a0-76505019468b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac17b226-3948-49c7-b775-602b73f3a949', 'volume_name': 'volume-ac17b226-3948-49c7-b775-602b73f3a949', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a838b170-1604-443a-a2f3-bbf426eb5d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a838b170-1604-443a-a2f3-bbf426eb5d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71068b3-3ef1-444d-b6ae-2e7c1256a627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:52 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Volume ac17b226-3948-49c7-b775-602b73f3a949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac17b226-3948-49c7-b775-602b73f3a949', 'volume_size': 1}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:52 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2 1073741824" returned: 0 in 0.614s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:52 devstack sudo[87055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2
Apr 13 20:30:52 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Acquiring lock "cinder-07101cae-6a8e-49f1-b24b-dbe9ab792b98-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Lock "cinder-07101cae-6a8e-49f1-b24b-dbe9ab792b98-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Acquiring lock "cinder-quobyte-07101cae-6a8e-49f1-b24b-dbe9ab792b98" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Lock "cinder-quobyte-07101cae-6a8e-49f1-b24b-dbe9ab792b98" acquired by "delete_volume" :: waited 0.021s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad257c04-6b02-46b6-98ab-91534b5ce808]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:52 devstack sudo[87057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98
Apr 13 20:30:52 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:52 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2" returned: 0 in 0.485s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a0b15636-6500-4f63-a658-07dc73a8c47c,created_at=2026-04-13T18:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1359168531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a0b15636-6500-4f63-a658-07dc73a8c47c,host='devstack@QuobyteHD#QuobyteHD',id=ac17b226-3948-49c7-b775-602b73f3a949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbbb04ab187439bbc346f7264164f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:52Z,use_quota=True,user_id='7b3e8a84ece944dc822bfed0986d310f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b87581ce-5857-4c6a-99d0-0ebd655fd786),volume_type_id=b87581ce-5857-4c6a-99d0-0ebd655fd786)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Creating volume ac17b226-3948-49c7-b775-602b73f3a949 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:30:52 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611e93db-42af-4202-b140-f70d9999886f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:52 devstack sudo[87060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949 1073741824
Apr 13 20:30:52 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a3ef91-5d22-4a75-9552-7f213e645983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:52 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Volume volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2 (4823a2c2-24c9-4f67-ac86-d73a78576ee2): created successfully
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a3ef91-5d22-4a75-9552-7f213e645983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Flow 'volume_create_manager' (1a779f9c-1bc8-4539-bdee-e28f294ccb4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:52 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-43b1c289-978e-43f6-a8a7-a6aab55682c0 tempest-VolumesTestJSON-2133221849 None] Created volume successfully.
Apr 13 20:30:53 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98" returned: 0 in 0.601s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:53 devstack sudo[87066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98
Apr 13 20:30:53 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:53 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949 1073741824" returned: 0 in 0.594s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:53 devstack sudo[87070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949
Apr 13 20:30:53 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:53 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-07101cae-6a8e-49f1-b24b-dbe9ab792b98" returned: 0 in 0.508s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Lock "cinder-quobyte-07101cae-6a8e-49f1-b24b-dbe9ab792b98" released by "delete_volume" :: held 1.133s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:53 devstack cinder-volume[82824]: WARNING cinder.quota [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1490873496 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1490873496, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:30:53 devstack cinder-volume[82824]: WARNING cinder.quota [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1490873496 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1490873496, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Created reservations ['43e2176c-0ef3-4cbc-b291-9a77242f234f', 'ed3cca34-b577-42f0-8d14-9e26ba031836', 'ffc32946-a248-442c-8c5c-cd3e018b2b95', '9ebba714-dab4-4ce1-81d7-43bbe4ce9d3b'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:53 devstack sudo[87074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:53 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:54 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949" returned: 0 in 0.509s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71068b3-3ef1-444d-b6ae-2e7c1256a627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac17b226-3948-49c7-b775-602b73f3a949', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b456d5a7-4940-40a2-9f0e-bbf736a89b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:54 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Volume volume-ac17b226-3948-49c7-b775-602b73f3a949 (ac17b226-3948-49c7-b775-602b73f3a949): created successfully
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b456d5a7-4940-40a2-9f0e-bbf736a89b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Flow 'volume_create_manager' (0bbc1889-9a84-4b5e-af74-fc760be55ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:54 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-cdb74494-101a-4be5-bdd5-626a0982ce26 tempest-GroupsTest-949575412 None] Created volume successfully.
Apr 13 20:30:54 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "cinder-4823a2c2-24c9-4f67-ac86-d73a78576ee2-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.623s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:54 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Deleted volume successfully.
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Lock "cinder-4823a2c2-24c9-4f67-ac86-d73a78576ee2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00aa7575-e2bb-4f67-8a8a-071d1be12a76 tempest-VolumeTypesAccessTest-33909653 None] Lock "cinder-07101cae-6a8e-49f1-b24b-dbe9ab792b98-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Flow 'volume_create_manager' (9f48909e-ed9a-4a4e-85af-86814c0ca8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2977679a-a36c-420b-ab88-c34bba3a2fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "cinder-quobyte-4823a2c2-24c9-4f67-ac86-d73a78576ee2" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2977679a-a36c-420b-ab88-c34bba3a2fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-994220013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a0b15636-6500-4f63-a658-07dc73a8c47c,host='devstack@QuobyteHD#QuobyteHD',id=7c1f8ce4-280e-462e-aebb-f35235b464cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbbb04ab187439bbc346f7264164f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:55Z,use_quota=True,user_id='7b3e8a84ece944dc822bfed0986d310f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b87581ce-5857-4c6a-99d0-0ebd655fd786),volume_type_id=b87581ce-5857-4c6a-99d0-0ebd655fd786)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c24521-efd4-43df-a34d-166360c48618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c24521-efd4-43df-a34d-166360c48618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79d2b5e-1f54-4b5a-9825-6d451ebec1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79d2b5e-1f54-4b5a-9825-6d451ebec1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c1f8ce4-280e-462e-aebb-f35235b464cc', 'volume_name': 'volume-7c1f8ce4-280e-462e-aebb-f35235b464cc', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b28905-eaf0-4983-978f-36f8d40668c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b28905-eaf0-4983-978f-36f8d40668c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41490103-e11f-46fa-8d9d-a60a028d5a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:54 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Volume 7c1f8ce4-280e-462e-aebb-f35235b464cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c1f8ce4-280e-462e-aebb-f35235b464cc', 'volume_size': 1}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a0b15636-6500-4f63-a658-07dc73a8c47c,created_at=2026-04-13T18:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-994220013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a0b15636-6500-4f63-a658-07dc73a8c47c,host='devstack@QuobyteHD#QuobyteHD',id=7c1f8ce4-280e-462e-aebb-f35235b464cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbbb04ab187439bbc346f7264164f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:30:55Z,use_quota=True,user_id='7b3e8a84ece944dc822bfed0986d310f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b87581ce-5857-4c6a-99d0-0ebd655fd786),volume_type_id=b87581ce-5857-4c6a-99d0-0ebd655fd786)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Creating volume 7c1f8ce4-280e-462e-aebb-f35235b464cc {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:30:54 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Lock "cinder-quobyte-4823a2c2-24c9-4f67-ac86-d73a78576ee2" acquired by "delete_volume" :: waited 0.055s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:54 devstack sudo[87077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc 1073741824
Apr 13 20:30:54 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca5b4e2-23a8-4b0d-bce1-08464bb6a291]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:54 devstack sudo[87079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2
Apr 13 20:30:54 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:55 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc 1073741824" returned: 0 in 0.653s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:55 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2" returned: 0 in 0.649s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:55 devstack sudo[87087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc
Apr 13 20:30:55 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:55 devstack sudo[87088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2
Apr 13 20:30:55 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:55 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4823a2c2-24c9-4f67-ac86-d73a78576ee2" returned: 0 in 0.503s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:55 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Lock "cinder-quobyte-4823a2c2-24c9-4f67-ac86-d73a78576ee2" released by "delete_volume" :: held 1.191s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:55 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Created reservations ['1918528f-e58f-4155-ae63-8a37503b3813', '8c47ed4b-49ab-42a0-96df-6717b0a2dc2b', 'ab270c75-6ba9-4d46-83f5-57520669f4c9', '6b92edc4-b381-4cb3-9405-319342b61644'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:55 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc" returned: 0 in 0.620s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41490103-e11f-46fa-8d9d-a60a028d5a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1f8ce4-280e-462e-aebb-f35235b464cc', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7e790e-291b-41f6-a575-a90c7f719c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:30:56 devstack sudo[87093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:56 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:56 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Volume volume-7c1f8ce4-280e-462e-aebb-f35235b464cc (7c1f8ce4-280e-462e-aebb-f35235b464cc): created successfully
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7e790e-291b-41f6-a575-a90c7f719c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Flow 'volume_create_manager' (9f48909e-ed9a-4a4e-85af-86814c0ca8eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:30:56 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-39dff9cf-09ed-417d-9051-f79f9531bf87 tempest-GroupsTest-949575412 None] Created volume successfully.
Apr 13 20:30:56 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.569s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:56 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Deleted volume successfully.
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6c51ab82-49c0-46f8-83ad-6b93ec4edde3 tempest-VolumesTestJSON-2133221849 None] Lock "cinder-4823a2c2-24c9-4f67-ac86-d73a78576ee2-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Acquiring lock "cinder-7d55aae9-6b2d-4043-8217-57019903ec3e-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Lock "cinder-7d55aae9-6b2d-4043-8217-57019903ec3e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Acquiring lock "cinder-quobyte-7d55aae9-6b2d-4043-8217-57019903ec3e" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Lock "cinder-quobyte-7d55aae9-6b2d-4043-8217-57019903ec3e" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed125f6-1a81-4015-90b6-d1f83aa87baf]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:56 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-dd3b4a70-88b3-4b06-b6d3-a2e4e9d4e136 tempest-GroupsTest-949575412 None] Update group completed successfully.
Apr 13 20:30:57 devstack sudo[87096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e
Apr 13 20:30:57 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:57 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e" returned: 0 in 0.609s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:57 devstack sudo[87101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e
Apr 13 20:30:57 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:57 devstack cinder-volume[82824]: DEBUG oslo_service.periodic_task [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82824) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:57 devstack sudo[87103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:57 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:58 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7d55aae9-6b2d-4043-8217-57019903ec3e" returned: 0 in 0.520s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Lock "cinder-quobyte-7d55aae9-6b2d-4043-8217-57019903ec3e" released by "delete_volume" :: held 1.168s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:58 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.500s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Created reservations ['20594ea4-7829-47b8-b02a-cfe21d6f9b65', 'c4696175-aea7-4ab1-8f35-a403b0f02d27', '479724a9-47ad-4db3-bcf4-c78acc2c3755', 'da264a06-adf6-4e13-a25d-d7b161d18659'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:58 devstack sudo[87107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:30:58 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:58 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d7296b40-8d5f-4b59-8f72-0163f8ce7925 tempest-GroupsTest-949575412 None] Update group completed successfully.
Apr 13 20:30:58 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.568s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:30:58 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Deleted volume successfully.
Apr 13 20:30:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-24dd3678-ed7e-47e8-8cc6-545d495e8c2b tempest-VolumesTestJSON-2133221849 None] Lock "cinder-7d55aae9-6b2d-4043-8217-57019903ec3e-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "cinder-9347000d-a672-4cd6-ae1a-a6ed684a5c5d-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Lock "cinder-9347000d-a672-4cd6-ae1a-a6ed684a5c5d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "cinder-quobyte-9347000d-a672-4cd6-ae1a-a6ed684a5c5d" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Lock "cinder-quobyte-9347000d-a672-4cd6-ae1a-a6ed684a5c5d" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6639a6-150a-4eb1-91bb-5efbec2c99ba]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:59 devstack sudo[87110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d
Apr 13 20:30:59 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Acquiring lock "cinder-quobyte-7c1f8ce4-280e-462e-aebb-f35235b464cc" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Lock "cinder-quobyte-7c1f8ce4-280e-462e-aebb-f35235b464cc" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[56428047-711d-42a4-a6f8-2f9d6e7039ae]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:59 devstack sudo[87116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc
Apr 13 20:30:59 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:30:59 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d" returned: 0 in 0.599s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:30:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:30:59 devstack sudo[87118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d
Apr 13 20:30:59 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:00 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc" returned: 0 in 0.562s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:00 devstack sudo[87123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc
Apr 13 20:31:00 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:00 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9347000d-a672-4cd6-ae1a-a6ed684a5c5d" returned: 0 in 0.579s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Lock "cinder-quobyte-9347000d-a672-4cd6-ae1a-a6ed684a5c5d" released by "delete_volume" :: held 1.207s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Created reservations ['c6ff3335-b4d2-4b6f-a98b-3500b34542f1', 'be12dcc8-225e-4fab-85d5-7f594c4af94b', '405eb0e6-c2a2-4f3d-845b-0dbe57f33312', '33462d07-6e50-400d-9b2f-4da7e2ab6a55'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:00 devstack sudo[87126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:00 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:00 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7c1f8ce4-280e-462e-aebb-f35235b464cc" returned: 0 in 0.606s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Lock "cinder-quobyte-7c1f8ce4-280e-462e-aebb-f35235b464cc" released by "delete_volume" :: held 1.194s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Acquiring lock "cinder-quobyte-ac17b226-3948-49c7-b775-602b73f3a949" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Lock "cinder-quobyte-ac17b226-3948-49c7-b775-602b73f3a949" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcacf570-430e-46bf-8025-5d6e99670f11]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:00 devstack sudo[87130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949
Apr 13 20:31:00 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:00 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.580s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:00 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Deleted volume successfully.
Apr 13 20:31:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-405a7d3e-4643-43d0-a1a4-b42cd42d7846 tempest-VolumesTestJSON-2133221849 None] Lock "cinder-9347000d-a672-4cd6-ae1a-a6ed684a5c5d-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:01 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949" returned: 0 in 0.688s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:01 devstack sudo[87135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949
Apr 13 20:31:01 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:02 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac17b226-3948-49c7-b775-602b73f3a949" returned: 0 in 0.666s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Lock "cinder-quobyte-ac17b226-3948-49c7-b775-602b73f3a949" released by "delete_volume" :: held 1.382s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Flow 'volume_create_manager' (fc667875-6912-4cc2-9f42-6f1a03e489a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05088d64-90f6-4c06-9770-33df110faad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05088d64-90f6-4c06-9770-33df110faad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-664725956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a71a99-4fb5-462f-830d-c288c8a06ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdd3f2bbfea4ed38b89f25a717e8424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:02Z,use_quota=True,user_id='b6e0b806c2f1408884ba578c193239b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab8b136-9e4a-4965-8484-ecffbd3be08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab8b136-9e4a-4965-8484-ecffbd3be08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b033d1-7286-4b71-9853-2868534cc909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b033d1-7286-4b71-9853-2868534cc909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a71a99-4fb5-462f-830d-c288c8a06ee3', 'volume_name': 'volume-84a71a99-4fb5-462f-830d-c288c8a06ee3', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f07c0b-63fb-48b7-96d5-2e563a9a44a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f07c0b-63fb-48b7-96d5-2e563a9a44a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbbbe05-ecb5-48e3-b5bf-77b5b202751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:02 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Volume 84a71a99-4fb5-462f-830d-c288c8a06ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a71a99-4fb5-462f-830d-c288c8a06ee3', 'volume_size': 1}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-664725956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a71a99-4fb5-462f-830d-c288c8a06ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdd3f2bbfea4ed38b89f25a717e8424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:02Z,use_quota=True,user_id='b6e0b806c2f1408884ba578c193239b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Creating volume 84a71a99-4fb5-462f-830d-c288c8a06ee3 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:02 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Created reservations ['467269e8-8b1f-4b5f-ab5a-2a60bd5f36f0'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:02 devstack sudo[87138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3 1073741824
Apr 13 20:31:02 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:02 devstack cinder-volume[82824]: WARNING cinder.quota [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-174156795 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-174156795, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:31:02 devstack cinder-volume[82824]: WARNING cinder.quota [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-174156795 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-174156795, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Created reservations ['23cf20bd-952d-4cd7-a1be-d7ebcb6c7bb4', 'ef0f30f6-32aa-4cae-ae81-a7ddcd5ca001', '718ca651-5517-4e18-b837-df4eaaa3b0e4', '58abd444-7876-4e29-85e2-ab5f1e6db40e'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Created reservations ['cfdd3671-212a-492d-b379-493eb9aebf3b', '32561d10-02d2-4ed8-b931-7510586efe84', '6df1f73a-0b47-462e-b62b-6401f339418a', '28087b8c-5c89-4dae-9bc8-ec49274b8371'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:02 devstack sudo[87140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:02 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Flow 'volume_create_manager' (801fcbb5-844f-40f7-9315-27b224a6b098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7944f3-da84-4381-a43a-c298b5e72829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7944f3-da84-4381-a43a-c298b5e72829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-434006915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51e90e6-f289-4ceb-8dfd-8c1756e3b3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e6967fe4afe4a2197cea9044d1dbd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:03Z,use_quota=True,user_id='a0a62f077620483fa789f140d39ee7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48977fc4-5b89-46fc-b635-c5e3a986e710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48977fc4-5b89-46fc-b635-c5e3a986e710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db47f9e-8aef-4c16-aa2b-0f9e5c196f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db47f9e-8aef-4c16-aa2b-0f9e5c196f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51e90e6-f289-4ceb-8dfd-8c1756e3b3de', 'volume_name': 'volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af244d36-3eee-4c77-9420-5758679da69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af244d36-3eee-4c77-9420-5758679da69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb821b5-5a3c-4d58-8864-089db807dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:02 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Volume f51e90e6-f289-4ceb-8dfd-8c1756e3b3de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de', 'volume_size': 1}
Apr 13 20:31:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:02 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.486s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:03 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-77f8ddb6-8a34-4425-8fc1-45b1cb7546b1 tempest-GroupsTest-949575412 None] Delete group completed successfully.
Apr 13 20:31:03 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3 1073741824" returned: 0 in 0.722s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:03 devstack sudo[87146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3
Apr 13 20:31:03 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:03 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3" returned: 0 in 0.529s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-434006915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51e90e6-f289-4ceb-8dfd-8c1756e3b3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e6967fe4afe4a2197cea9044d1dbd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:03Z,use_quota=True,user_id='a0a62f077620483fa789f140d39ee7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Creating volume f51e90e6-f289-4ceb-8dfd-8c1756e3b3de {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:03 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbbbe05-ecb5-48e3-b5bf-77b5b202751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a71a99-4fb5-462f-830d-c288c8a06ee3', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0c2eaf-c730-4550-9594-9dec287c7338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:03 devstack sudo[87149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de 1073741824
Apr 13 20:31:03 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:03 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Volume volume-84a71a99-4fb5-462f-830d-c288c8a06ee3 (84a71a99-4fb5-462f-830d-c288c8a06ee3): created successfully
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0c2eaf-c730-4550-9594-9dec287c7338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Flow 'volume_create_manager' (fc667875-6912-4cc2-9f42-6f1a03e489a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:03 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-dc33aa20-11b0-4b66-bf74-6356424f430f tempest-VolumeQuotasAdminTestJSON-141256185 None] Created volume successfully.
Apr 13 20:31:04 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de 1073741824" returned: 0 in 0.601s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:04 devstack sudo[87154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de
Apr 13 20:31:04 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Acquiring lock "cinder-84a71a99-4fb5-462f-830d-c288c8a06ee3-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "cinder-84a71a99-4fb5-462f-830d-c288c8a06ee3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Acquiring lock "cinder-quobyte-84a71a99-4fb5-462f-830d-c288c8a06ee3" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "cinder-quobyte-84a71a99-4fb5-462f-830d-c288c8a06ee3" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea43b0e3-2eed-453f-a44c-8135b09eb63d]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:04 devstack sudo[87156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3
Apr 13 20:31:04 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:04 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de" returned: 0 in 0.520s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb821b5-5a3c-4d58-8864-089db807dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900ceac3-3138-44d5-8ffe-c8557a1e024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:04 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Volume volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de (f51e90e6-f289-4ceb-8dfd-8c1756e3b3de): created successfully
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900ceac3-3138-44d5-8ffe-c8557a1e024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Flow 'volume_create_manager' (801fcbb5-844f-40f7-9315-27b224a6b098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:04 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-270d2c65-30e2-4a41-8c43-924fec8ecece tempest-VolumesMetadataTest-745996035 None] Created volume successfully.
Apr 13 20:31:05 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3" returned: 0 in 0.704s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:05 devstack sudo[87162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3
Apr 13 20:31:05 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Acquiring lock "cinder-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Lock "cinder-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Acquiring lock "cinder-quobyte-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Lock "cinder-quobyte-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[73544a2d-560a-46a7-8e7c-1cf478563b56]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:05 devstack sudo[87164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de
Apr 13 20:31:05 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:05 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-84a71a99-4fb5-462f-830d-c288c8a06ee3" returned: 0 in 0.558s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "cinder-quobyte-84a71a99-4fb5-462f-830d-c288c8a06ee3" released by "delete_volume" :: held 1.286s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Created reservations ['90aeecac-4298-46bb-90be-e04176ff632d', 'c3263ae6-2445-497e-a79d-c6c3baa2c903', '696a9150-96cd-42a8-bef1-d2a8b782a207', '8fefb264-135d-425b-94f9-0962adea9bab'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:05 devstack sudo[87167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:05 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:06 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de" returned: 0 in 0.664s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:06 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.485s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:06 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Deleted volume successfully.
Apr 13 20:31:06 devstack sudo[87173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de
Apr 13 20:31:06 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-077b1f64-6c01-4243-8dd2-dcfcd75daf23 tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "cinder-84a71a99-4fb5-462f-830d-c288c8a06ee3-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:06 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-38de1cf7-654e-4d7d-b87d-6d179ba6b486 tempest-GroupsV314Test-1795562925 None] Group tempest-GroupsV314Test-Group-435292657: creating
Apr 13 20:31:06 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-38de1cf7-654e-4d7d-b87d-6d179ba6b486 tempest-GroupsV314Test-1795562925 None] Group tempest-GroupsV314Test-Group-435292657: created successfully
Apr 13 20:31:06 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-38de1cf7-654e-4d7d-b87d-6d179ba6b486 tempest-GroupsV314Test-1795562925 None] Create group completed successfully.
Apr 13 20:31:06 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de" returned: 0 in 0.433s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Lock "cinder-quobyte-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de" released by "delete_volume" :: held 1.126s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Created reservations ['22cf46ca-b124-45b7-ae1d-d616f8f81580', 'f6764d78-2f8e-4561-894e-8fb6ed3d4b6a', '19f274c9-752b-4b7e-9f1d-93205b513c90', '5340038f-d094-4504-a4c3-c2c35f604319'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:06 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:06 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Flow 'volume_create_manager' (85d77f04-b3cf-492e-94da-741513a2e9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04c638f-9bd4-4c01-81d2-1b6620b58521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04c638f-9bd4-4c01-81d2-1b6620b58521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-519753707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ebfeb5-e759-42e6-9f5c-7187041b01f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdd3f2bbfea4ed38b89f25a717e8424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:07Z,use_quota=True,user_id='b6e0b806c2f1408884ba578c193239b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2add7596-8165-480b-958f-63a9a6f669b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2add7596-8165-480b-958f-63a9a6f669b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81218b39-c0c4-406c-9934-fb382d0c758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81218b39-c0c4-406c-9934-fb382d0c758f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ebfeb5-e759-42e6-9f5c-7187041b01f3', 'volume_name': 'volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53f4f36-3bd0-47a0-bad3-1afa83f67ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53f4f36-3bd0-47a0-bad3-1afa83f67ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c7b542-fee8-42e6-87f1-f99a78678ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:07 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Volume 22ebfeb5-e759-42e6-9f5c-7187041b01f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3', 'volume_size': 1}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-519753707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ebfeb5-e759-42e6-9f5c-7187041b01f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdd3f2bbfea4ed38b89f25a717e8424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:07Z,use_quota=True,user_id='b6e0b806c2f1408884ba578c193239b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Creating volume 22ebfeb5-e759-42e6-9f5c-7187041b01f3 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:07 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:07 devstack sudo[87178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3 1073741824
Apr 13 20:31:07 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:07 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.402s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:07 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Deleted volume successfully.
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-800b3fdf-89e4-4283-ad11-48221f4bed4a tempest-VolumesMetadataTest-745996035 None] Lock "cinder-f51e90e6-f289-4ceb-8dfd-8c1756e3b3de-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:07 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3 1073741824" returned: 0 in 0.498s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:07 devstack sudo[87184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3
Apr 13 20:31:07 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Flow 'volume_create_manager' (a2b463c6-3392-4f1b-8fdc-dac86b946a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670841d8-6cc2-4785-8b25-faa629d06281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670841d8-6cc2-4785-8b25-faa629d06281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1062171821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78f2b4df-0bb1-4515-8c11-11efb5230c0c,host='devstack@QuobyteHD#QuobyteHD',id=f2dba28d-221c-4caa-baa6-d46c28df998b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b39c804b2a4464aa8e1cd7efb154451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:08Z,use_quota=True,user_id='20d26180ba074a95b782762551cc0254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0501616b-6643-4064-aec6-21ef3063fc0f),volume_type_id=0501616b-6643-4064-aec6-21ef3063fc0f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b1f86e-3485-4324-bd79-f03a577c4475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b1f86e-3485-4324-bd79-f03a577c4475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5550ab-e915-4b4c-80a0-3f6684a09587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5550ab-e915-4b4c-80a0-3f6684a09587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2dba28d-221c-4caa-baa6-d46c28df998b', 'volume_name': 'volume-f2dba28d-221c-4caa-baa6-d46c28df998b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80888947-2582-4a9d-9881-dd3fa070beda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80888947-2582-4a9d-9881-dd3fa070beda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4072413-c2bb-413e-a091-2db5eb7e69ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:08 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Volume f2dba28d-221c-4caa-baa6-d46c28df998b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2dba28d-221c-4caa-baa6-d46c28df998b', 'volume_size': 1}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:08 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3" returned: 0 in 0.604s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=78f2b4df-0bb1-4515-8c11-11efb5230c0c,created_at=2026-04-13T18:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1062171821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78f2b4df-0bb1-4515-8c11-11efb5230c0c,host='devstack@QuobyteHD#QuobyteHD',id=f2dba28d-221c-4caa-baa6-d46c28df998b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b39c804b2a4464aa8e1cd7efb154451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:08Z,use_quota=True,user_id='20d26180ba074a95b782762551cc0254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0501616b-6643-4064-aec6-21ef3063fc0f),volume_type_id=0501616b-6643-4064-aec6-21ef3063fc0f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Creating volume f2dba28d-221c-4caa-baa6-d46c28df998b {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:08 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c7b542-fee8-42e6-87f1-f99a78678ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c17a583-5811-4b6f-97db-292ac4874537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:08 devstack sudo[87187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b 1073741824
Apr 13 20:31:08 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:08 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Volume volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3 (22ebfeb5-e759-42e6-9f5c-7187041b01f3): created successfully
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c17a583-5811-4b6f-97db-292ac4874537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Flow 'volume_create_manager' (85d77f04-b3cf-492e-94da-741513a2e9ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:08 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-aeec5d88-58ed-45a0-bcf5-1baaf38df492 tempest-VolumeQuotasAdminTestJSON-141256185 None] Created volume successfully.
Apr 13 20:31:08 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b 1073741824" returned: 0 in 0.657s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:08 devstack sudo[87192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b
Apr 13 20:31:08 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:09 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b" returned: 0 in 0.534s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4072413-c2bb-413e-a091-2db5eb7e69ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2dba28d-221c-4caa-baa6-d46c28df998b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afe7311-943a-4b36-b2b1-d03fc5db78ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:09 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Volume volume-f2dba28d-221c-4caa-baa6-d46c28df998b (f2dba28d-221c-4caa-baa6-d46c28df998b): created successfully
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afe7311-943a-4b36-b2b1-d03fc5db78ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Flow 'volume_create_manager' (a2b463c6-3392-4f1b-8fdc-dac86b946a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:09 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-9e84ca26-703d-446e-a0b9-2560d8145c44 tempest-GroupsV314Test-1795562925 None] Created volume successfully.
Apr 13 20:31:09 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-02f94c4d-a562-45aa-a094-67a656aae7aa tempest-VolumeQuotasAdminTestJSON-1114487791 None] Transfer volume completed successfully.
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (839b1205-0f2e-49c5-a8ea-1e7fdac8d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106b012a-29c5-4f65-9b0c-eead52253bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106b012a-29c5-4f65-9b0c-eead52253bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1202859609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9b8b27-a741-4146-a5a5-df21d498c4c2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:10Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff84a801-7149-48df-842f-69a691079f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff84a801-7149-48df-842f-69a691079f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7974499c-800d-4735-b38a-18fe9450ce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7974499c-800d-4735-b38a-18fe9450ce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9b8b27-a741-4146-a5a5-df21d498c4c2', 'volume_name': 'volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ea5553-9f2a-4e5a-93c0-65637529a6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ea5553-9f2a-4e5a-93c0-65637529a6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773dafa6-da33-43e2-a689-dbce69d6db2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:09 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Volume 1b9b8b27-a741-4146-a5a5-df21d498c4c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2', 'volume_size': 1}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1202859609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9b8b27-a741-4146-a5a5-df21d498c4c2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:10Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Creating volume 1b9b8b27-a741-4146-a5a5-df21d498c4c2 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:09 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:09 devstack sudo[87196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2 1073741824
Apr 13 20:31:09 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:10 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2 1073741824" returned: 0 in 0.642s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Flow 'volume_create_manager' (6e5c7ab9-8752-4522-9080-84d8b2025194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d43fa29-e463-4a77-8e77-6ee7a3a4527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d43fa29-e463-4a77-8e77-6ee7a3a4527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-976219116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c58eca-e526-4021-a9fb-ad1fd328660e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66909e1a698408d926ebc1bb83e695e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:11Z,use_quota=True,user_id='6c81d09877d449c2ab2abfa44fea998b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deea6003-d9aa-4060-9ca6-7db4f27a91e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deea6003-d9aa-4060-9ca6-7db4f27a91e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a58e8a-a093-4a39-b7c9-6a537c57d3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.image.glance [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Creating Keystone auth plugin from conf {{(pid=82824) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Acquiring lock "cinder-22ebfeb5-e759-42e6-9f5c-7187041b01f3-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Lock "cinder-22ebfeb5-e759-42e6-9f5c-7187041b01f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:10 devstack sudo[87209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2
Apr 13 20:31:10 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Acquiring lock "cinder-quobyte-22ebfeb5-e759-42e6-9f5c-7187041b01f3" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Lock "cinder-quobyte-22ebfeb5-e759-42e6-9f5c-7187041b01f3" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5174bd92-6cbd-4f0a-8c04-dfe918fbd56e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a58e8a-a093-4a39-b7c9-6a537c57d3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9c58eca-e526-4021-a9fb-ad1fd328660e', 'volume_name': 'volume-a9c58eca-e526-4021-a9fb-ad1fd328660e', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f056e320>}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:10 devstack sudo[87211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3
Apr 13 20:31:10 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c573d74-bc32-4d82-a694-feae91887d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c573d74-bc32-4d82-a694-feae91887d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9fb0ae-1222-425c-b520-82ee903a00fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:10 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Volume a9c58eca-e526-4021-a9fb-ad1fd328660e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9c58eca-e526-4021-a9fb-ad1fd328660e', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f056e320>}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Trying to clone a9c58eca-e526-4021-a9fb-ad1fd328660e from image 1af62cce-55dd-41f2-805b-b88f968d7cf0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]). {{(pid=82824) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 20:31:10 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 20:31:11 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd3b3b8-ebff-470a-8174-a0bb4a02b880]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:11 devstack sudo[87214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD
Apr 13 20:31:11 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:11 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2" returned: 0 in 0.448s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773dafa6-da33-43e2-a689-dbce69d6db2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5759e2-f7ac-4c2f-9fc7-e81b1006f94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:11 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Volume volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2 (1b9b8b27-a741-4146-a5a5-df21d498c4c2): created successfully
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5759e2-f7ac-4c2f-9fc7-e81b1006f94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (839b1205-0f2e-49c5-a8ea-1e7fdac8d305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:11 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8eb7c87b-f9ba-4fe2-aeb1-567a3d042d62 tempest-VolumesGetTest-1692548070 None] Created volume successfully.
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:11 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Cloning volume f2dba28d-221c-4caa-baa6-d46c28df998b to volume c96cc7a7-91bf-4bc0-b615-9066a25ef51f
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Creating offline snapshot 0fb53729-9289-4253-b17e-fdfb6500be97 of volume f2dba28d-221c-4caa-baa6-d46c28df998b {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdad08a-b00d-4e6d-b9cb-51b9f5f548a1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:11 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3" returned: 0 in 0.589s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:11 devstack sudo[87221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3
Apr 13 20:31:11 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:11 devstack sudo[87220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b
Apr 13 20:31:11 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:11 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD" returned: 0 in 0.537s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Temporary image 1af62cce-55dd-41f2-805b-b88f968d7cf0 is fetched for user 6c81d09877d449c2ab2abfa44fea998b. {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7552a07d-5760-4e84-862e-24b72a0c95ca]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:11 devstack sudo[87227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD
Apr 13 20:31:11 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:11 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-22ebfeb5-e759-42e6-9f5c-7187041b01f3" returned: 0 in 0.426s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Lock "cinder-quobyte-22ebfeb5-e759-42e6-9f5c-7187041b01f3" released by "delete_volume" :: held 1.039s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Created reservations ['7a38f756-7fa7-4880-8c59-56e0d8a71c00', '70641be0-c05a-4008-9803-38f6c8887464', '4fb31f71-3f25-4dac-87b9-eb2ae9bf133b', 'a4847a77-4acd-4b5e-bb7d-31e09a00c2cc'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:11 devstack sudo[87233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:11 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:11 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b" returned: 0 in 0.537s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:11 devstack sudo[87235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97 1G
Apr 13 20:31:11 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:12 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD" returned: 0 in 0.547s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:12 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97 1G" returned: 0 in 0.481s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2dba28d-221c-4caa-baa6-d46c28df998b -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:12 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2dba28d-221c-4caa-baa6-d46c28df998b -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97
Apr 13 20:31:12 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:12 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.545s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:12 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Deleted volume successfully.
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-05df953d-5492-4ad8-8049-6d5408237b3a tempest-VolumeQuotasAdminTestJSON-671104920 None] Lock "cinder-22ebfeb5-e759-42e6-9f5c-7187041b01f3-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=189,cinder:UPDATE=254,cinder:INSERT=63,cinder:DELETE=20 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=223,cinder:INSERT=56,cinder:UPDATE=235,cinder:DELETE=9 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (ea2f283f-2e4e-4325-81f2-5f18b1a0d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbeb7c3-8132-47d4-8d86-2366a76f2981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbeb7c3-8132-47d4-8d86-2366a76f2981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1610815888',display_name='tempest-VolumesGetTest-Volume-1969158943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2475c37b-bdc4-4a09-9905-ddf973346103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:12Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddeee63-f6af-4f01-91d5-4e89ef07bf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddeee63-f6af-4f01-91d5-4e89ef07bf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a89698c-a561-4307-8a7a-95fe02788d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a89698c-a561-4307-8a7a-95fe02788d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2475c37b-bdc4-4a09-9905-ddf973346103', 'volume_name': 'volume-2475c37b-bdc4-4a09-9905-ddf973346103', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d1bd3d-6288-401d-88d6-472c7d647ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d1bd3d-6288-401d-88d6-472c7d647ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4515abd0-9db7-48d6-b54d-84f32f3c5cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:12 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Volume 2475c37b-bdc4-4a09-9905-ddf973346103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2475c37b-bdc4-4a09-9905-ddf973346103', 'volume_size': 1}
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:12 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2dba28d-221c-4caa-baa6-d46c28df998b -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97" returned: 0 in 0.504s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:12 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:31:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:12 devstack sudo[87249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97
Apr 13 20:31:12 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:13 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97" returned: 0 in 0.472s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:13 devstack sudo[87252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.info
Apr 13 20:31:13 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:13 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.info" returned: 0 in 0.477s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:13 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:31:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:13 devstack sudo[87255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.info
Apr 13 20:31:13 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:14 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.info" returned: 0 in 0.423s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Acquiring lock "cinder-quobyte-c96cc7a7-91bf-4bc0-b615-9066a25ef51f" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Lock "cinder-quobyte-c96cc7a7-91bf-4bc0-b615-9066a25ef51f" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] snapshot: 0fb53729-9289-4253-b17e-fdfb6500be97, volume: c96cc7a7-91bf-4bc0-b615-9066a25ef51f,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8f9b16-c411-4051-b5ec-f1a670ea9e6c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:14 devstack sudo[87258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97
Apr 13 20:31:14 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:14 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97" returned: 0 in 0.602s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2dba28d-221c-4caa-baa6-d46c28df998b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37dcd19-b912-4625-b8d3-0fdd9a23dcd0]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:14 devstack sudo[87263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b
Apr 13 20:31:14 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:15 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b" returned: 0 in 0.562s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:15 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:31:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:15 devstack sudo[87302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f
Apr 13 20:31:15 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:17 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f" returned: 0 in 2.304s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:17 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7cda65-4382-48a2-a202-3b06816d1740]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:17 devstack sudo[87315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b
Apr 13 20:31:17 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Flow 'volume_create_manager' (68911594-02e6-4868-b6e0-4867515486ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec1e810-3a56-4c4c-b916-08c00db7d358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec1e810-3a56-4c4c-b916-08c00db7d358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1007346092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46309ea-8886-4d76-826d-f1280f89b14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73292941d2264281bea3a7e77333c513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:18Z,use_quota=True,user_id='23f2830f7bfd4265a4a417661f30c0f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ca67bf-68e0-4b79-906f-084935f3aabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ca67bf-68e0-4b79-906f-084935f3aabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d289e6-a0d4-409d-a067-61e06631d7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d289e6-a0d4-409d-a067-61e06631d7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f46309ea-8886-4d76-826d-f1280f89b14d', 'volume_name': 'volume-f46309ea-8886-4d76-826d-f1280f89b14d', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045c2ffc-9bbe-48c3-9df3-a7167feb6837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045c2ffc-9bbe-48c3-9df3-a7167feb6837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485e59c3-e067-4f22-ab19-87dbfcf82c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:18 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Volume f46309ea-8886-4d76-826d-f1280f89b14d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f46309ea-8886-4d76-826d-f1280f89b14d', 'volume_size': 1}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:18 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b" returned: 0 in 0.665s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:31:18 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Converted 1024.00 MB image at 444.28 MB/s
Apr 13 20:31:18 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:18 devstack sudo[87321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f
Apr 13 20:31:18 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:18 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f" returned: 0 in 0.414s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Lock "cinder-quobyte-c96cc7a7-91bf-4bc0-b615-9066a25ef51f" released by "_copy_volume_from_snapshot" :: held 4.593s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Acquiring lock "cinder-quobyte-0fb53729-9289-4253-b17e-fdfb6500be97" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Lock "cinder-quobyte-0fb53729-9289-4253-b17e-fdfb6500be97" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Deleting offline snapshot 0fb53729-9289-4253-b17e-fdfb6500be97 of volume f2dba28d-221c-4caa-baa6-d46c28df998b {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] snapshot_file for this snap is: volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[64571f6d-846a-4ceb-9424-323112a9f059]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:18 devstack sudo[87324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97
Apr 13 20:31:18 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:19 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97" returned: 0 in 0.477s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2dba28d-221c-4caa-baa6-d46c28df998b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:31:19 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcbb513-59bd-46b1-89ae-67db49d452a0]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:19 devstack sudo[87330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b
Apr 13 20:31:19 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:19 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:19 devstack sudo[87335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97
Apr 13 20:31:19 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:20 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97" returned: 0 in 0.478s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:20 devstack sudo[87340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97
Apr 13 20:31:20 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:20 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b.0fb53729-9289-4253-b17e-fdfb6500be97" returned: 0 in 0.411s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Lock "cinder-quobyte-0fb53729-9289-4253-b17e-fdfb6500be97" released by "_delete_snapshot" :: held 1.897s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.496s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.604s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-976219116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c58eca-e526-4021-a9fb-ad1fd328660e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66909e1a698408d926ebc1bb83e695e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:11Z,use_quota=True,user_id='6c81d09877d449c2ab2abfa44fea998b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Creating volume a9c58eca-e526-4021-a9fb-ad1fd328660e {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:20 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:20 devstack sudo[87343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e 1073741824
Apr 13 20:31:20 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:20 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-04dd7b40-c4e2-42e7-925a-25b7ccd64f05 tempest-GroupsV314Test-1795562925 None] Create group from source-group-78f2b4df-0bb1-4515-8c11-11efb5230c0c completed successfully.
Apr 13 20:31:21 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e 1073741824" returned: 0 in 0.517s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:21 devstack sudo[87348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e
Apr 13 20:31:21 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Acquiring lock "cinder-quobyte-c96cc7a7-91bf-4bc0-b615-9066a25ef51f" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Lock "cinder-quobyte-c96cc7a7-91bf-4bc0-b615-9066a25ef51f" acquired by "delete_volume" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[538789a8-a4e4-408e-ae53-78b07ff9b64e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:21 devstack sudo[87350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f
Apr 13 20:31:21 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:21 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e" returned: 0 in 0.444s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.260s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1610815888',display_name='tempest-VolumesGetTest-Volume-1969158943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2475c37b-bdc4-4a09-9905-ddf973346103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:12Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Creating volume 2475c37b-bdc4-4a09-9905-ddf973346103 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:21 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:21 devstack sudo[87353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103 1073741824
Apr 13 20:31:21 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Attempting download of 1af62cce-55dd-41f2-805b-b88f968d7cf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}])) to volume a9c58eca-e526-4021-a9fb-ad1fd328660e. {{(pid=82824) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[e711538c-317a-4958-9b72-98e07bf84ce9]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_e7qo90a0 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:21 devstack sudo[87355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_e7qo90a0
Apr 13 20:31:21 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:22 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f" returned: 0 in 0.502s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:22 devstack sudo[87360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f
Apr 13 20:31:22 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:22 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103 1073741824" returned: 0 in 0.498s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:22 devstack sudo[87367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103
Apr 13 20:31:22 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:22 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_e7qo90a0" returned: 0 in 0.498s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_e7qo90a0 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:22 devstack sudo[87369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_e7qo90a0
Apr 13 20:31:22 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:22 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c96cc7a7-91bf-4bc0-b615-9066a25ef51f" returned: 0 in 0.444s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Lock "cinder-quobyte-c96cc7a7-91bf-4bc0-b615-9066a25ef51f" released by "delete_volume" :: held 0.971s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Created reservations ['86fdaa74-b7d8-4f0e-a788-688da3d6ee4e'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:22 devstack cinder-volume[82824]: WARNING cinder.quota [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1475455672 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1475455672, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:31:22 devstack cinder-volume[82824]: WARNING cinder.quota [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1475455672 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1475455672, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Created reservations ['62b7d5ad-d826-46d6-8d3d-986162bac4be', 'f250b49c-cbfe-4035-b8ee-bf42eb474b0e', 'eeb0d6f8-a624-48ae-ae83-da6a628bd75e', '2d76932f-388d-432b-afa2-7f51941a44bb'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:22 devstack sudo[87373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:22 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:22 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103" returned: 0 in 0.418s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.575s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1007346092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46309ea-8886-4d76-826d-f1280f89b14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73292941d2264281bea3a7e77333c513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:18Z,use_quota=True,user_id='23f2830f7bfd4265a4a417661f30c0f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Creating volume f46309ea-8886-4d76-826d-f1280f89b14d {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:22 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4515abd0-9db7-48d6-b54d-84f32f3c5cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2475c37b-bdc4-4a09-9905-ddf973346103', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:22 devstack sudo[87375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d 1073741824
Apr 13 20:31:22 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d705ab-1117-40a5-a932-c48d9623e059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:22 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Volume volume-2475c37b-bdc4-4a09-9905-ddf973346103 (2475c37b-bdc4-4a09-9905-ddf973346103): created successfully
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d705ab-1117-40a5-a932-c48d9623e059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (ea2f283f-2e4e-4325-81f2-5f18b1a0d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:22 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0decbb8b-7f50-4fe8-be9c-b42d4444251f tempest-VolumesGetTest-1692548070 None] Created volume successfully.
Apr 13 20:31:22 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_e7qo90a0" returned: 1 in 0.532s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_e7qo90a0' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[245ebedf-c412-4850-bc2f-bd2d7e9d58fe]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:22 devstack sudo[87379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD
Apr 13 20:31:22 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:23 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.431s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:23 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-656e223d-1f02-4be1-b1a1-8cba0e911f67 tempest-GroupsV314Test-1795562925 None] Delete group completed successfully.
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-2475c37b-bdc4-4a09-9905-ddf973346103-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Lock "cinder-2475c37b-bdc4-4a09-9905-ddf973346103-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-quobyte-2475c37b-bdc4-4a09-9905-ddf973346103" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-2475c37b-bdc4-4a09-9905-ddf973346103" acquired by "delete_volume" :: waited 0.019s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af9f262-9de4-4963-bce5-c0b140066f0a]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:23 devstack sudo[87385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103
Apr 13 20:31:23 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:23 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d 1073741824" returned: 0 in 0.603s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:23 devstack sudo[87390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d
Apr 13 20:31:23 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:23 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD" returned: 0 in 0.509s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] 1af62cce-55dd-41f2-805b-b88f968d7cf0 was qcow2, converting to raw {{(pid=82824) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:23 devstack sudo[87392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e
Apr 13 20:31:23 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:23 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103" returned: 0 in 0.563s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:23 devstack sudo[87401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103
Apr 13 20:31:23 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:23 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Acquiring lock "cinder-quobyte-f2dba28d-221c-4caa-baa6-d46c28df998b" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d" returned: 0 in 0.456s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485e59c3-e067-4f22-ab19-87dbfcf82c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46309ea-8886-4d76-826d-f1280f89b14d', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4758bfa-475c-420d-ba14-9292f95958bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Lock "cinder-quobyte-f2dba28d-221c-4caa-baa6-d46c28df998b" acquired by "delete_volume" :: waited 0.031s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:23 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Volume volume-f46309ea-8886-4d76-826d-f1280f89b14d (f46309ea-8886-4d76-826d-f1280f89b14d): created successfully
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4758bfa-475c-420d-ba14-9292f95958bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Flow 'volume_create_manager' (68911594-02e6-4868-b6e0-4867515486ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[973c5e8b-07fe-466d-88ed-dac62f42e933]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:23 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-ddcec25f-f18c-447d-9ed6-205b22e9502d tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Created volume successfully.
Apr 13 20:31:23 devstack sudo[87406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b
Apr 13 20:31:23 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:24 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2475c37b-bdc4-4a09-9905-ddf973346103" returned: 0 in 0.515s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-2475c37b-bdc4-4a09-9905-ddf973346103" released by "delete_volume" :: held 1.098s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:24 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e" returned: 0 in 0.891s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_p1rnly81devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:31:24 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Converted 112.00 MB image at 112.00 MB/s
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:24 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e 1G
Apr 13 20:31:24 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Created reservations ['457c8788-f2ae-4064-a7a7-2c121a5fd5b9', '1e90ea1b-51bf-4075-aeb0-09dd5ff5fc6e', '3090a7e1-d11c-42ab-b1de-36891fe82d74', '4d040fd4-f428-4ffc-ac96-650d2f7c0100'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:24 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b" returned: 0 in 0.532s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:24 devstack sudo[87414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:24 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:24 devstack sudo[87415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b
Apr 13 20:31:24 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Creating offline snapshot 02a5c3a6-fc26-4184-a2b2-b8f6d6476403 of volume f46309ea-8886-4d76-826d-f1280f89b14d {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec9c91d-606b-4478-a3f6-a022ab383c95]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:24 devstack sudo[87418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d
Apr 13 20:31:24 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:24 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e 1G" returned: 0 in 0.523s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:24 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f2dba28d-221c-4caa-baa6-d46c28df998b" returned: 0 in 0.417s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Lock "cinder-quobyte-f2dba28d-221c-4caa-baa6-d46c28df998b" released by "delete_volume" :: held 0.994s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6af906-f513-48a6-83ff-2967bbf29aea]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:24 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.497s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:24 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Deleted volume successfully.
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a9c9c603-d02b-43db-a880-9c0a2f2d6c19 tempest-VolumesGetTest-1692548070 None] Lock "cinder-2475c37b-bdc4-4a09-9905-ddf973346103-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Created reservations ['dce0f625-85f7-402c-a681-a01ad791c1da'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:24 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Created reservations ['6a8d24e4-7925-417e-b555-ddaea2a57cf5', '56895e6d-9c4c-4583-ae1f-3e43b18b55e2', '5fad9c5d-9fb0-42fe-a585-88aebe6610cf', '481828a6-6abe-443a-958b-3afd4979462f'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:24 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e
Apr 13 20:31:24 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:25 devstack sudo[87430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:25 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:25 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d" returned: 0 in 0.514s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:25 devstack sudo[87432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403 1G
Apr 13 20:31:25 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-1b9b8b27-a741-4146-a5a5-df21d498c4c2-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Lock "cinder-1b9b8b27-a741-4146-a5a5-df21d498c4c2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-quobyte-1b9b8b27-a741-4146-a5a5-df21d498c4c2" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-1b9b8b27-a741-4146-a5a5-df21d498c4c2" acquired by "delete_volume" :: waited 0.025s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[81186aae-fa23-43d5-99c4-e5c788d29ead]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:25 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e" returned: 0 in 0.644s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:25 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.508s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:25 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-7aecadf1-b346-48e4-b6eb-d4d18efa6c83 tempest-GroupsV314Test-1795562925 None] Delete group completed successfully.
Apr 13 20:31:25 devstack sudo[87440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2
Apr 13 20:31:25 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:25 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403 1G" returned: 0 in 0.490s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f46309ea-8886-4d76-826d-f1280f89b14d -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:25 devstack sudo[87441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e
Apr 13 20:31:25 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:25 devstack sudo[87443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f46309ea-8886-4d76-826d-f1280f89b14d -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403
Apr 13 20:31:25 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:25 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2" returned: 0 in 0.495s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:25 devstack sudo[87454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2
Apr 13 20:31:25 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:26 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e" returned: 1 in 0.525s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Downloaded image 1af62cce-55dd-41f2-805b-b88f968d7cf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}])) to volume a9c58eca-e526-4021-a9fb-ad1fd328660e successfully. {{(pid=82824) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Temporary image 1af62cce-55dd-41f2-805b-b88f968d7cf0 for user 6c81d09877d449c2ab2abfa44fea998b is deleted. {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Marking volume a9c58eca-e526-4021-a9fb-ad1fd328660e as bootable. {{(pid=82824) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Copying metadata from image 1af62cce-55dd-41f2-805b-b88f968d7cf0 to a9c58eca-e526-4021-a9fb-ad1fd328660e. {{(pid=82824) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Creating volume glance metadata for volume a9c58eca-e526-4021-a9fb-ad1fd328660e backed by image 1af62cce-55dd-41f2-805b-b88f968d7cf0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82824) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 20:31:26 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f46309ea-8886-4d76-826d-f1280f89b14d -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403" returned: 0 in 0.510s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:26 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403 is being set with open permissions: ugo+rw
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:26 devstack sudo[87457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9fb0ae-1222-425c-b520-82ee903a00fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c58eca-e526-4021-a9fb-ad1fd328660e', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f056e320>}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:26 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c497af40-301e-4773-bd99-3f84fdaa760e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:26 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Volume volume-a9c58eca-e526-4021-a9fb-ad1fd328660e (a9c58eca-e526-4021-a9fb-ad1fd328660e): created successfully
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c497af40-301e-4773-bd99-3f84fdaa760e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Flow 'volume_create_manager' (6e5c7ab9-8752-4522-9080-84d8b2025194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:26 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5b25e765-9540-4a6c-a335-739b1cf3d45f tempest-VolumesImageMetadata-410591857 None] Created volume successfully.
Apr 13 20:31:26 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1b9b8b27-a741-4146-a5a5-df21d498c4c2" returned: 0 in 0.462s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-1b9b8b27-a741-4146-a5a5-df21d498c4c2" released by "delete_volume" :: held 0.990s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Created reservations ['ab14d69d-9813-4da8-8cfa-ffae80a77fa5', '4187d501-50a2-4d8c-8a10-e3a36ecc9360', 'ffc2ab1c-9282-420e-9730-f29397057b4d', '111d2548-62b5-4d91-bd15-ed900c28c0c6'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:26 devstack sudo[87461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:26 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:26 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403" returned: 0 in 0.494s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:26 devstack sudo[87463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.info
Apr 13 20:31:26 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Acquiring lock "cinder-a9c58eca-e526-4021-a9fb-ad1fd328660e-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Lock "cinder-a9c58eca-e526-4021-a9fb-ad1fd328660e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Acquiring lock "cinder-quobyte-a9c58eca-e526-4021-a9fb-ad1fd328660e" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Lock "cinder-quobyte-a9c58eca-e526-4021-a9fb-ad1fd328660e" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a813e0-c409-402a-8b8f-fd4beaa62ff6]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:27 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.488s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:27 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Deleted volume successfully.
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d938032b-755c-4401-9b45-381cdd4b1018 tempest-VolumesGetTest-1692548070 None] Lock "cinder-1b9b8b27-a741-4146-a5a5-df21d498c4c2-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:27 devstack sudo[87465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e
Apr 13 20:31:27 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:27 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.info" returned: 0 in 0.558s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:27 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.info is being set with open permissions: ugo+rw
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:27 devstack sudo[87470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.info
Apr 13 20:31:27 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:27 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e" returned: 0 in 0.608s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:27 devstack sudo[87474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e
Apr 13 20:31:27 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:27 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.info" returned: 0 in 0.470s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.099s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:27 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-42f763de-371f-4c94-895d-7b191b5b0107 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Create snapshot completed successfully
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (dc73201f-c1bd-4690-9748-9b29af9c823c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02240a70-a4f3-445c-a8b1-2475deff1977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02240a70-a4f3-445c-a8b1-2475deff1977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-309099281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34537a5-ccf0-41b8-bceb-9f29037b9c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:28Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faa97b3-5a82-4340-a6cc-f4a0f150ecc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faa97b3-5a82-4340-a6cc-f4a0f150ecc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0404c23-83c9-4957-84ed-807094eb4f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0404c23-83c9-4957-84ed-807094eb4f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34537a5-ccf0-41b8-bceb-9f29037b9c04', 'volume_name': 'volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8158f9b3-44ad-41aa-a8b2-515117559619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8158f9b3-44ad-41aa-a8b2-515117559619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5127856d-83c7-4e19-9d78-ea10952db25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:27 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Volume f34537a5-ccf0-41b8-bceb-9f29037b9c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04', 'volume_size': 1}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-309099281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34537a5-ccf0-41b8-bceb-9f29037b9c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:28Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Creating volume f34537a5-ccf0-41b8-bceb-9f29037b9c04 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:27 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:27 devstack sudo[87478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 1073741824
Apr 13 20:31:27 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:28 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e" returned: 1 in 0.587s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:28 devstack sudo[87483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e
Apr 13 20:31:28 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:28 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 1073741824" returned: 0 in 0.592s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:28 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9c58eca-e526-4021-a9fb-ad1fd328660e" returned: 0 in 0.444s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:28 devstack sudo[87489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04
Apr 13 20:31:28 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Lock "cinder-quobyte-a9c58eca-e526-4021-a9fb-ad1fd328660e" released by "delete_volume" :: held 1.688s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Created reservations ['fa29ad3e-d49b-4cb9-832f-602b11fa1463', '1a7ba5ef-bbe7-43eb-ac62-e34f17f5cfbe', '0eb37ad3-db7c-45c8-9a9c-3d7de5ed4146', 'f18379d5-5fcf-441f-9de4-a2773404923d'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:28 devstack sudo[87491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:28 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:28 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04" returned: 0 in 0.475s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5127856d-83c7-4e19-9d78-ea10952db25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da5d917-8ba8-42e4-984a-093dffdea6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:29 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Volume volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 (f34537a5-ccf0-41b8-bceb-9f29037b9c04): created successfully
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da5d917-8ba8-42e4-984a-093dffdea6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (dc73201f-c1bd-4690-9748-9b29af9c823c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:29 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0e742504-b4db-4540-9768-6d2c0207e721 tempest-VolumesGetTest-1692548070 None] Created volume successfully.
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Acquiring lock "cinder-02a5c3a6-fc26-4184-a2b2-b8f6d6476403-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "cinder-02a5c3a6-fc26-4184-a2b2-b8f6d6476403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Acquiring lock "cinder-quobyte-f46309ea-8886-4d76-826d-f1280f89b14d" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "cinder-quobyte-f46309ea-8886-4d76-826d-f1280f89b14d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Acquiring lock "cinder-quobyte-02a5c3a6-fc26-4184-a2b2-b8f6d6476403" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "cinder-quobyte-02a5c3a6-fc26-4184-a2b2-b8f6d6476403" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Deleting offline snapshot 02a5c3a6-fc26-4184-a2b2-b8f6d6476403 of volume f46309ea-8886-4d76-826d-f1280f89b14d {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] snapshot_file for this snap is: volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a5847c-72cc-4091-a656-4275dca28ce1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:29 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.575s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:29 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Deleted volume successfully.
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0c15b1f9-a5a7-405b-b791-0a74046279a8 tempest-VolumesImageMetadata-410591857 None] Lock "cinder-a9c58eca-e526-4021-a9fb-ad1fd328660e-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:29 devstack sudo[87495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403
Apr 13 20:31:29 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:29 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b93dd5d5-740b-4aa9-a3db-dd7e289ec0fb tempest-GroupsV320Test-48275247 None] Group tempest-GroupsV320Test-Group-240914852: creating
Apr 13 20:31:29 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b93dd5d5-740b-4aa9-a3db-dd7e289ec0fb tempest-GroupsV320Test-48275247 None] Group tempest-GroupsV320Test-Group-240914852: created successfully
Apr 13 20:31:29 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b93dd5d5-740b-4aa9-a3db-dd7e289ec0fb tempest-GroupsV320Test-48275247 None] Create group completed successfully.
Apr 13 20:31:29 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403" returned: 0 in 0.606s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f46309ea-8886-4d76-826d-f1280f89b14d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1569eeaf-2b05-4897-ac5c-2b60bd821f64]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:29 devstack sudo[87501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d
Apr 13 20:31:29 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (5fb7490c-f46e-4c01-a06f-04cf3ff47b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b28397a-9b7c-4d30-bfe4-326ddd8dbeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b28397a-9b7c-4d30-bfe4-326ddd8dbeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1088944857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ff2bf5-1274-46dd-a375-a7e6010fb163,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f34537a5-ccf0-41b8-bceb-9f29037b9c04,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:30Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6120ca5-a1ef-4a19-bd9e-1eb123db74c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6120ca5-a1ef-4a19-bd9e-1eb123db74c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193b663c-e906-415d-9020-a2e4f1dcde34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:30 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d" returned: 0 in 0.610s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:30 devstack sudo[87506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403
Apr 13 20:31:30 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193b663c-e906-415d-9020-a2e4f1dcde34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '37ff2bf5-1274-46dd-a375-a7e6010fb163', 'volume_name': 'volume-37ff2bf5-1274-46dd-a375-a7e6010fb163', 'volume_size': 1, 'source_volid': 'f34537a5-ccf0-41b8-bceb-9f29037b9c04', 'source_volstatus': 'available'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2faecad-fbc3-4d11-90fa-e46f87ee02c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2faecad-fbc3-4d11-90fa-e46f87ee02c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c7d78f-cd62-4daf-88f8-759133c6264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:30 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Volume 37ff2bf5-1274-46dd-a375-a7e6010fb163: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-37ff2bf5-1274-46dd-a375-a7e6010fb163', 'volume_size': 1, 'source_volid': 'f34537a5-ccf0-41b8-bceb-9f29037b9c04', 'source_volstatus': 'available'}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:30 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Cloning volume f34537a5-ccf0-41b8-bceb-9f29037b9c04 to volume 37ff2bf5-1274-46dd-a375-a7e6010fb163
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Creating offline snapshot 20fbe272-bf19-49a7-883b-d22ca0f75535 of volume f34537a5-ccf0-41b8-bceb-9f29037b9c04 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fe1c48-2183-40db-8662-912285b42bea]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:30 devstack sudo[87508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04
Apr 13 20:31:30 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-4d5cdb32-83fc-4b92-b746-9c75511ad932 tempest-GroupsV320Test-48275247 None] Created reservations ['ec11910f-8bcd-4618-bd7f-f0cf47238ce7'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d5cdb32-83fc-4b92-b746-9c75511ad932 tempest-GroupsV320Test-48275247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d5cdb32-83fc-4b92-b746-9c75511ad932 tempest-GroupsV320Test-48275247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4d5cdb32-83fc-4b92-b746-9c75511ad932 tempest-GroupsV320Test-48275247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4d5cdb32-83fc-4b92-b746-9c75511ad932 tempest-GroupsV320Test-48275247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d5cdb32-83fc-4b92-b746-9c75511ad932 tempest-GroupsV320Test-48275247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d5cdb32-83fc-4b92-b746-9c75511ad932 tempest-GroupsV320Test-48275247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:30 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403" returned: 0 in 0.568s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:30 devstack sudo[87513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:30 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:30 devstack sudo[87516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403
Apr 13 20:31:30 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:31 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04" returned: 0 in 0.568s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:31 devstack sudo[87520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535 1G
Apr 13 20:31:31 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:31 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d5cdb32-83fc-4b92-b746-9c75511ad932 tempest-GroupsV320Test-48275247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.574s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-4d5cdb32-83fc-4b92-b746-9c75511ad932 tempest-GroupsV320Test-48275247 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-4d5cdb32-83fc-4b92-b746-9c75511ad932 tempest-GroupsV320Test-48275247 None] Delete group completed successfully.
Apr 13 20:31:31 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d.02a5c3a6-fc26-4184-a2b2-b8f6d6476403" returned: 0 in 0.582s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "cinder-quobyte-02a5c3a6-fc26-4184-a2b2-b8f6d6476403" released by "_delete_snapshot" :: held 2.426s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "cinder-quobyte-f46309ea-8886-4d76-826d-f1280f89b14d" released by "delete_snapshot" :: held 2.443s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Created reservations ['4a5df0e9-bcc8-4135-9d00-0ff99d9c66b2', '38cc710f-3168-426c-88ff-4954506390fb', '74963193-df1b-4a9d-84ee-2499202456c1', 'a32a0a99-4ba6-410f-8396-c83e15220e7e'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:31 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535 1G" returned: 0 in 0.570s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Delete snapshot completed successfully.
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-11556b29-37d0-44a2-92f7-1752c0cbab7a tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "cinder-02a5c3a6-fc26-4184-a2b2-b8f6d6476403-delete_snapshot" released by "delete_snapshot" :: held 2.547s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:31 devstack sudo[87527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535
Apr 13 20:31:31 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Flow 'volume_create_manager' (a13275bd-779c-40c1-b3b2-895781fb3380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18a0a2e-17b8-4c7f-b6bf-b3418e275b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18a0a2e-17b8-4c7f-b6bf-b3418e275b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-286568212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea421e1-0a30-4d0d-a841-d64cb6a2c70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462e959f307043d3bf7a05c1bf8c89f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:32Z,use_quota=True,user_id='c1e576cba6004819abb31c4ec7df0799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa9ab71-6ed2-4920-ba7e-e8e9e5e71ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa9ab71-6ed2-4920-ba7e-e8e9e5e71ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a421ec-c264-49f2-88db-d9962a1a6931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a421ec-c264-49f2-88db-d9962a1a6931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea421e1-0a30-4d0d-a841-d64cb6a2c70b', 'volume_name': 'volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67986c2-d74d-4ae0-89aa-73194a24a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67986c2-d74d-4ae0-89aa-73194a24a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395f7c2e-51a3-4df8-a803-a037d59d9467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:31 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Volume 3ea421e1-0a30-4d0d-a841-d64cb6a2c70b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b', 'volume_size': 1}
Apr 13 20:31:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:32 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535" returned: 0 in 0.467s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:32 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535 is being set with open permissions: ugo+rw
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:32 devstack sudo[87532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535
Apr 13 20:31:32 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Acquiring lock "cinder-f46309ea-8886-4d76-826d-f1280f89b14d-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "cinder-f46309ea-8886-4d76-826d-f1280f89b14d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Acquiring lock "cinder-quobyte-f46309ea-8886-4d76-826d-f1280f89b14d" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "cinder-quobyte-f46309ea-8886-4d76-826d-f1280f89b14d" acquired by "delete_volume" :: waited 0.018s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bc2e7e-1cf0-4968-8523-e258791bf0d7]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:32 devstack sudo[87534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d
Apr 13 20:31:32 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:32 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535" returned: 0 in 0.486s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:32 devstack sudo[87537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.info
Apr 13 20:31:32 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:32 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d" returned: 0 in 0.521s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:32 devstack sudo[87542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d
Apr 13 20:31:32 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:33 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.info" returned: 0 in 0.514s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:33 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.info is being set with open permissions: ugo+rw
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:33 devstack sudo[87545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.info
Apr 13 20:31:33 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:33 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f46309ea-8886-4d76-826d-f1280f89b14d" returned: 0 in 0.458s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "cinder-quobyte-f46309ea-8886-4d76-826d-f1280f89b14d" released by "delete_volume" :: held 1.013s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Created reservations ['11a30a0a-9c03-497a-98b4-849172f4b9ba', 'f62b2aa6-7a58-4138-a350-3be2c4dcacab', '8c51e06c-210c-4465-8138-51711f692e02', '4fe16c29-a6b7-456f-a2b1-e0e48a76e8e2'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:33 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:33 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:33 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.info" returned: 0 in 0.486s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-quobyte-37ff2bf5-1274-46dd-a375-a7e6010fb163" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-37ff2bf5-1274-46dd-a375-a7e6010fb163" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] snapshot: 20fbe272-bf19-49a7-883b-d22ca0f75535, volume: 37ff2bf5-1274-46dd-a375-a7e6010fb163,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb231aa4-f1a7-4c62-a774-c8f4dc78d3b9]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:33 devstack sudo[87551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535
Apr 13 20:31:33 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:33 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.470s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:33 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Deleted volume successfully.
Apr 13 20:31:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0b3e496a-4547-4e4d-965c-d1a4e955f7c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-558366011 None] Lock "cinder-f46309ea-8886-4d76-826d-f1280f89b14d-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:34 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535" returned: 0 in 0.489s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:31:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:31:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:31:34 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[278bd747-392d-4aed-ab9d-f95a1456dab5]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:34 devstack sudo[87557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04
Apr 13 20:31:34 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:34 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04" returned: 0 in 0.534s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:34 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163 not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:31:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:34 devstack sudo[87562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163
Apr 13 20:31:34 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:37 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163" returned: 0 in 2.498s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:37 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaed108-c986-4f21-8594-d732f6c2216d]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:37 devstack sudo[87574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04
Apr 13 20:31:37 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:37 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04" returned: 0 in 0.808s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:37 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04, size 1024.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163 {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:31:37 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Converted 1024.00 MB image at 409.60 MB/s
Apr 13 20:31:37 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163 is being set with open permissions: ugo+rw
Apr 13 20:31:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:38 devstack sudo[87579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163
Apr 13 20:31:38 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:38 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163" returned: 0 in 0.533s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-37ff2bf5-1274-46dd-a375-a7e6010fb163" released by "_copy_volume_from_snapshot" :: held 4.916s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-quobyte-20fbe272-bf19-49a7-883b-d22ca0f75535" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-20fbe272-bf19-49a7-883b-d22ca0f75535" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Deleting offline snapshot 20fbe272-bf19-49a7-883b-d22ca0f75535 of volume f34537a5-ccf0-41b8-bceb-9f29037b9c04 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:31:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] snapshot_file for this snap is: volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:31:38 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f9e355-49b6-47b0-8ad6-3cb27eed02ac]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:38 devstack sudo[87582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535
Apr 13 20:31:38 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:39 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535" returned: 0 in 0.587s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:31:39 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b3f778-6a5e-4190-88fd-ac10fc5dc65e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:39 devstack sudo[87587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04
Apr 13 20:31:39 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:39 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04" returned: 0 in 0.570s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:39 devstack sudo[87593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535
Apr 13 20:31:39 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Flow 'volume_create_manager' (197c17d7-f543-4ab2-87e9-24ef82005dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977d2c30-2a05-4f72-8d9d-ee9b8417b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977d2c30-2a05-4f72-8d9d-ee9b8417b636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1112542632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286dd00f-e96b-43eb-bc69-f7cd66f7d74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5884e4a53d2d4cd7bb8fb0db906b8375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:40Z,use_quota=True,user_id='7379b0209d4c424ca6359b4d308dc099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a005a9e-0d3f-4f67-b67d-ffdcaade22e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a005a9e-0d3f-4f67-b67d-ffdcaade22e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cee01d-52bd-45d1-be11-3d6acb878c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cee01d-52bd-45d1-be11-3d6acb878c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286dd00f-e96b-43eb-bc69-f7cd66f7d74f', 'volume_name': 'volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6dc982-34ae-4827-b618-27593c021571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6dc982-34ae-4827-b618-27593c021571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c8052f-f335-4609-88c7-4cf938c8f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:40 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Volume 286dd00f-e96b-43eb-bc69-f7cd66f7d74f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f', 'volume_size': 1}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:40 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535" returned: 0 in 0.573s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:40 devstack sudo[87598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535
Apr 13 20:31:40 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:40 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04.20fbe272-bf19-49a7-883b-d22ca0f75535" returned: 0 in 0.450s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-20fbe272-bf19-49a7-883b-d22ca0f75535" released by "_delete_snapshot" :: held 2.236s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.359s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.969s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-286568212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea421e1-0a30-4d0d-a841-d64cb6a2c70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462e959f307043d3bf7a05c1bf8c89f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:32Z,use_quota=True,user_id='c1e576cba6004819abb31c4ec7df0799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Creating volume 3ea421e1-0a30-4d0d-a841-d64cb6a2c70b {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:40 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c7d78f-cd62-4daf-88f8-759133c6264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ff2bf5-1274-46dd-a375-a7e6010fb163', 'volume_size': 1, 'source_volid': 'f34537a5-ccf0-41b8-bceb-9f29037b9c04', 'source_volstatus': 'available'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:40 devstack sudo[87601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b 1073741824
Apr 13 20:31:40 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa01c676-fff9-4897-9f14-390d8aefcb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:40 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Volume volume-37ff2bf5-1274-46dd-a375-a7e6010fb163 (37ff2bf5-1274-46dd-a375-a7e6010fb163): created successfully
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa01c676-fff9-4897-9f14-390d8aefcb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (5fb7490c-f46e-4c01-a06f-04cf3ff47b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:40 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-ae7ebe67-70ef-480e-9204-a25ef97fa28d tempest-VolumesGetTest-1692548070 None] Created volume successfully.
Apr 13 20:31:41 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b 1073741824" returned: 0 in 0.679s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:41 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b
Apr 13 20:31:41 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (9827dcea-0460-4339-8aaa-48be4cb0706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccbe0b8-a0b6-4d76-bc68-450a24bbee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccbe0b8-a0b6-4d76-bc68-450a24bbee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1789345997',display_name='tempest-VolumesGetTest-Volume-1222887228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c291eea-d314-45b5-9699-b8d3f091b572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:42Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94fbc2d-4d2f-4f70-8fb4-dccf9d5001e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94fbc2d-4d2f-4f70-8fb4-dccf9d5001e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe08f79-10c8-43d3-b171-ee5786eb87d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe08f79-10c8-43d3-b171-ee5786eb87d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c291eea-d314-45b5-9699-b8d3f091b572', 'volume_name': 'volume-1c291eea-d314-45b5-9699-b8d3f091b572', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b15247f-52ed-4a0e-810d-a3ce6b016ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b15247f-52ed-4a0e-810d-a3ce6b016ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad70838-7c08-451c-a345-100a6277e091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:41 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Volume 1c291eea-d314-45b5-9699-b8d3f091b572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c291eea-d314-45b5-9699-b8d3f091b572', 'volume_size': 1}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:41 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b" returned: 0 in 0.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.907s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1112542632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286dd00f-e96b-43eb-bc69-f7cd66f7d74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5884e4a53d2d4cd7bb8fb0db906b8375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:40Z,use_quota=True,user_id='7379b0209d4c424ca6359b4d308dc099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Creating volume 286dd00f-e96b-43eb-bc69-f7cd66f7d74f {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:41 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:42 devstack sudo[87609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f 1073741824
Apr 13 20:31:42 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:42 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395f7c2e-51a3-4df8-a803-a037d59d9467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:42 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a253b87-4f1f-429a-9a14-440aee128a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:42 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Volume volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b (3ea421e1-0a30-4d0d-a841-d64cb6a2c70b): created successfully
Apr 13 20:31:42 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a253b87-4f1f-429a-9a14-440aee128a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:42 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Flow 'volume_create_manager' (a13275bd-779c-40c1-b3b2-895781fb3380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:42 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-978a4396-2a1f-4b50-9d00-8f656dfbea8b tempest-VolumesTransfersTest-1529544026 None] Created volume successfully.
Apr 13 20:31:42 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f 1073741824" returned: 0 in 0.561s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:42 devstack sudo[87614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f
Apr 13 20:31:42 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:43 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f" returned: 0 in 0.528s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1789345997',display_name='tempest-VolumesGetTest-Volume-1222887228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c291eea-d314-45b5-9699-b8d3f091b572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:42Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Creating volume 1c291eea-d314-45b5-9699-b8d3f091b572 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:43 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:43 devstack sudo[87619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572 1073741824
Apr 13 20:31:43 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c8052f-f335-4609-88c7-4cf938c8f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37e27f0-cb9d-4e6a-8be3-5cfc1494a709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:43 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d1bca03d-b00d-4e6c-a1f8-315648f820e2 tempest-VolumesTransfersTest-507533869 None] Transfer volume completed successfully.
Apr 13 20:31:43 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Volume volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f (286dd00f-e96b-43eb-bc69-f7cd66f7d74f): created successfully
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37e27f0-cb9d-4e6a-8be3-5cfc1494a709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Flow 'volume_create_manager' (197c17d7-f543-4ab2-87e9-24ef82005dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:43 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-bda87e7d-4d01-4693-abfc-29c345399da6 tempest-VolumeQuotasNegativeTestJSON-917807753 None] Created volume successfully.
Apr 13 20:31:43 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572 1073741824" returned: 0 in 0.545s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:43 devstack sudo[87624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572
Apr 13 20:31:43 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Acquiring lock "cinder-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Lock "cinder-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Acquiring lock "cinder-quobyte-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Lock "cinder-quobyte-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b" acquired by "delete_volume" :: waited 0.015s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e864424-9818-4ba8-bd90-aba5de0a6692]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:44 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572" returned: 0 in 0.516s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad70838-7c08-451c-a345-100a6277e091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c291eea-d314-45b5-9699-b8d3f091b572', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02edc60-e426-4eef-a4c9-4e87ecc1f85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:44 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Volume volume-1c291eea-d314-45b5-9699-b8d3f091b572 (1c291eea-d314-45b5-9699-b8d3f091b572): created successfully
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02edc60-e426-4eef-a4c9-4e87ecc1f85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (9827dcea-0460-4339-8aaa-48be4cb0706c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:44 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-4d710710-2447-419f-b65d-bc00b4231f2b tempest-VolumesGetTest-1692548070 None] Created volume successfully.
Apr 13 20:31:44 devstack sudo[87627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b
Apr 13 20:31:44 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:44 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Acquiring lock "cinder-286dd00f-e96b-43eb-bc69-f7cd66f7d74f-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b" returned: 0 in 0.674s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Lock "cinder-286dd00f-e96b-43eb-bc69-f7cd66f7d74f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:44 devstack sudo[87632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b
Apr 13 20:31:44 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-1c291eea-d314-45b5-9699-b8d3f091b572-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Lock "cinder-1c291eea-d314-45b5-9699-b8d3f091b572-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Acquiring lock "cinder-quobyte-286dd00f-e96b-43eb-bc69-f7cd66f7d74f" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-quobyte-1c291eea-d314-45b5-9699-b8d3f091b572" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Lock "cinder-quobyte-286dd00f-e96b-43eb-bc69-f7cd66f7d74f" acquired by "delete_volume" :: waited 0.031s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58246e2-205c-4adb-9786-271a8e17d2e8]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-1c291eea-d314-45b5-9699-b8d3f091b572" acquired by "delete_volume" :: waited 0.050s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[74876c31-d8b9-487d-a4a1-11a3839d1afa]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:45 devstack sudo[87634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f
Apr 13 20:31:45 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:45 devstack sudo[87635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572
Apr 13 20:31:45 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:45 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b" returned: 0 in 0.502s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Lock "cinder-quobyte-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b" released by "delete_volume" :: held 1.204s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Created reservations ['6d7a58a0-381b-4b72-83bf-2bb90c968dba', 'e11b61d0-5ff9-4c67-a676-158380f78de0', '9f5bb7b0-e5c9-475b-9cb2-b7b17fa317e7', 'c00b4892-31e9-4241-a9cd-ca6672dfea16'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:45 devstack sudo[87642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:45 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:45 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f" returned: 0 in 0.515s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:45 devstack sudo[87644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f
Apr 13 20:31:45 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:45 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572" returned: 0 in 0.612s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:45 devstack sudo[87649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572
Apr 13 20:31:45 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:45 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.451s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:45 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Deleted volume successfully.
Apr 13 20:31:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb5da96f-1d03-4f49-8333-24f9418946ee tempest-VolumesTransfersTest-910363904 None] Lock "cinder-3ea421e1-0a30-4d0d-a841-d64cb6a2c70b-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:46 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-286dd00f-e96b-43eb-bc69-f7cd66f7d74f" returned: 0 in 0.477s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Lock "cinder-quobyte-286dd00f-e96b-43eb-bc69-f7cd66f7d74f" released by "delete_volume" :: held 1.038s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Created reservations ['5d8367fa-82ca-49d4-929f-83b28b733f52', '07691ef4-b3ee-4fad-9b5c-806462723fe8', 'b04e6450-f792-423a-844e-72075b169bb5', '6baac7a5-845a-4601-a096-76fa194edf5c'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:46 devstack sudo[87654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:46 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:46 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1c291eea-d314-45b5-9699-b8d3f091b572" returned: 0 in 0.498s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-1c291eea-d314-45b5-9699-b8d3f091b572" released by "delete_volume" :: held 1.137s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Created reservations ['9cd232c2-97f5-4b74-a1d1-0c53a33a5607', '5753efb1-f074-46dc-99a2-0226b7eaef99', '703a230d-edaa-430f-94df-b3d65344fc96', '38f08e1c-0c28-47e4-9f00-7128c58e4ac8'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:46 devstack sudo[87656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:46 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:46 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.448s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:46 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Deleted volume successfully.
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Flow 'volume_create_manager' (9ff32fa6-6ff0-4165-aa30-2726d57f6592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94ad926-afc8-4ddf-9a59-39778af14f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94ad926-afc8-4ddf-9a59-39778af14f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-813417574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1609eccd-e396-4478-80ec-ede6b8e72cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462e959f307043d3bf7a05c1bf8c89f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:47Z,use_quota=True,user_id='c1e576cba6004819abb31c4ec7df0799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c384847c-a952-46e2-aca1-0d39fef92c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c384847c-a952-46e2-aca1-0d39fef92c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4febcff-3213-4665-b88c-96f9c8110860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4febcff-3213-4665-b88c-96f9c8110860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1609eccd-e396-4478-80ec-ede6b8e72cbf', 'volume_name': 'volume-1609eccd-e396-4478-80ec-ede6b8e72cbf', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285f4d73-e0fb-4cdd-9147-32a5b4ad2289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285f4d73-e0fb-4cdd-9147-32a5b4ad2289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8d99db-a629-4a6f-b83d-b5118885520a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:46 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Volume 1609eccd-e396-4478-80ec-ede6b8e72cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1609eccd-e396-4478-80ec-ede6b8e72cbf', 'volume_size': 1}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-813417574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1609eccd-e396-4478-80ec-ede6b8e72cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462e959f307043d3bf7a05c1bf8c89f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:47Z,use_quota=True,user_id='c1e576cba6004819abb31c4ec7df0799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Creating volume 1609eccd-e396-4478-80ec-ede6b8e72cbf {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:46 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4bfb82b3-8d71-4bd9-a44f-c8a2e340328e tempest-VolumeQuotasNegativeTestJSON-917807753 None] Lock "cinder-286dd00f-e96b-43eb-bc69-f7cd66f7d74f-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:46 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf 1073741824
Apr 13 20:31:46 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:46 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.547s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:46 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Deleted volume successfully.
Apr 13 20:31:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-dd7704cf-97ad-47ac-b7b0-882f76f69cf4 tempest-VolumesGetTest-1692548070 None] Lock "cinder-1c291eea-d314-45b5-9699-b8d3f091b572-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-37ff2bf5-1274-46dd-a375-a7e6010fb163-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Lock "cinder-37ff2bf5-1274-46dd-a375-a7e6010fb163-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-quobyte-37ff2bf5-1274-46dd-a375-a7e6010fb163" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-37ff2bf5-1274-46dd-a375-a7e6010fb163" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1ec036-fb73-43c9-ab68-9cd6f6256176]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:47 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf 1073741824" returned: 0 in 0.630s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:47 devstack sudo[87665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163
Apr 13 20:31:47 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:47 devstack sudo[87667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf
Apr 13 20:31:47 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:47 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf" returned: 0 in 0.558s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8d99db-a629-4a6f-b83d-b5118885520a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1609eccd-e396-4478-80ec-ede6b8e72cbf', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1371f573-a868-415f-ad99-4f54180f36dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:47 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Volume volume-1609eccd-e396-4478-80ec-ede6b8e72cbf (1609eccd-e396-4478-80ec-ede6b8e72cbf): created successfully
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1371f573-a868-415f-ad99-4f54180f36dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Flow 'volume_create_manager' (9ff32fa6-6ff0-4165-aa30-2726d57f6592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:47 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-e91cae30-549a-4d1b-a9d0-0d513ca5977d tempest-VolumesTransfersTest-1529544026 None] Created volume successfully.
Apr 13 20:31:47 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163" returned: 0 in 0.720s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:48 devstack sudo[87673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163
Apr 13 20:31:48 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:48 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-37ff2bf5-1274-46dd-a375-a7e6010fb163" returned: 0 in 0.508s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-37ff2bf5-1274-46dd-a375-a7e6010fb163" released by "delete_volume" :: held 1.254s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:48 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Created reservations ['eebbf30c-555c-4372-83c2-ee6f4a565a24', 'd95b3431-aedf-48c5-8a9e-6220f96b32f0', 'da4bd567-2f2a-4b71-9796-2dbb47493442', '97e2eb64-942a-4a75-8e7d-aae8a4bd1d68'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:48 devstack sudo[87676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:48 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Acquiring lock "cinder-1609eccd-e396-4478-80ec-ede6b8e72cbf-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Lock "cinder-1609eccd-e396-4478-80ec-ede6b8e72cbf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Acquiring lock "cinder-quobyte-1609eccd-e396-4478-80ec-ede6b8e72cbf" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Lock "cinder-quobyte-1609eccd-e396-4478-80ec-ede6b8e72cbf" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:49 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.601s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c87030f-bd03-4984-ab6a-32013264d4cc]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:49 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Deleted volume successfully.
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2c5ceb45-82fd-49dd-9402-c239f4bcbf4f tempest-VolumesGetTest-1692548070 None] Lock "cinder-37ff2bf5-1274-46dd-a375-a7e6010fb163-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:49 devstack sudo[87680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf
Apr 13 20:31:49 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-f34537a5-ccf0-41b8-bceb-9f29037b9c04-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Lock "cinder-f34537a5-ccf0-41b8-bceb-9f29037b9c04-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-quobyte-f34537a5-ccf0-41b8-bceb-9f29037b9c04" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-f34537a5-ccf0-41b8-bceb-9f29037b9c04" acquired by "delete_volume" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbeb3f3-4873-480f-9247-4dfa282320b1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:49 devstack sudo[87682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04
Apr 13 20:31:49 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:49 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf" returned: 0 in 0.663s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:49 devstack sudo[87687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf
Apr 13 20:31:49 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:50 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04" returned: 0 in 0.694s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:50 devstack sudo[87692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04
Apr 13 20:31:50 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:50 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1609eccd-e396-4478-80ec-ede6b8e72cbf" returned: 0 in 0.734s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Lock "cinder-quobyte-1609eccd-e396-4478-80ec-ede6b8e72cbf" released by "delete_volume" :: held 1.439s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Created reservations ['88794976-f4f6-42c1-9396-1c00d5401556', 'c0c8d7bb-9399-4958-860d-36a1f23f7119', '3d1d9cfe-edce-499c-a0cf-c4e87f12777e', '2264de27-5f15-40e2-94e5-398e5e814e6f'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:50 devstack sudo[87695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:50 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:50 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f34537a5-ccf0-41b8-bceb-9f29037b9c04" returned: 0 in 0.680s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-f34537a5-ccf0-41b8-bceb-9f29037b9c04" released by "delete_volume" :: held 1.413s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Created reservations ['2f8a68a9-7cd3-42ad-9b51-15b14525d5e0', 'ca32064c-d3a4-4eec-80d9-b6955f83be8b', '725fba23-14d3-4a66-947e-551fd62f26e1', 'd270bee6-20c7-46f1-b579-0b0eba4d2639'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:51 devstack sudo[87698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:51 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:51 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.569s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:51 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Deleted volume successfully.
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-34a83fc2-6cac-4bf7-a576-3c169e500593 tempest-VolumesTransfersTest-910363904 None] Lock "cinder-1609eccd-e396-4478-80ec-ede6b8e72cbf-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:51 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.687s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:51 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Deleted volume successfully.
Apr 13 20:31:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4b82af2d-4663-43fb-b7b1-e29454587b5e tempest-VolumesGetTest-1692548070 None] Lock "cinder-f34537a5-ccf0-41b8-bceb-9f29037b9c04-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:52 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (3f75624c-287a-4bfa-bb1b-5aa3b23d12af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a25e97-3db9-45ab-8965-4f0f039a8111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a25e97-3db9-45ab-8965-4f0f039a8111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-551147985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789ddbe0-b045-45ff-820f-2bae074dd059,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:53Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc39089-9ac4-4fde-a220-330dee6c5564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc39089-9ac4-4fde-a220-330dee6c5564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b83fed9-d085-4075-b006-7c03103115d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:52 devstack cinder-volume[82824]: DEBUG cinder.image.glance [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Creating Keystone auth plugin from conf {{(pid=82824) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 20:31:52 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Flow 'volume_create_manager' (ed5a3e74-52ad-4ece-96a4-51b65dcaa381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5109a070-a20d-48cf-be88-58ffa0acea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5109a070-a20d-48cf-be88-58ffa0acea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1579554447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a6afd2-b85d-4a51-8ddf-07f112560746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764104e22d1c4fcf8f8ab233180e3230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:53Z,use_quota=True,user_id='5dcea81538b441bc9df600701bb3c9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae433491-2198-40f1-ac67-3ddc88ba4098),volume_type_id=ae433491-2198-40f1-ac67-3ddc88ba4098)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d21cb31-f509-40e7-a2d8-35e4ddc8d04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d21cb31-f509-40e7-a2d8-35e4ddc8d04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120e6754-73cd-433c-95e1-2b7f8777297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120e6754-73cd-433c-95e1-2b7f8777297f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a6afd2-b85d-4a51-8ddf-07f112560746', 'volume_name': 'volume-56a6afd2-b85d-4a51-8ddf-07f112560746', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc1ab21-2685-4bf4-ab46-1ef2ecb5177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc1ab21-2685-4bf4-ab46-1ef2ecb5177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef236fb-4c76-413f-9e68-6820b4b2f574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:53 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Volume 56a6afd2-b85d-4a51-8ddf-07f112560746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a6afd2-b85d-4a51-8ddf-07f112560746', 'volume_size': 1}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1579554447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a6afd2-b85d-4a51-8ddf-07f112560746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764104e22d1c4fcf8f8ab233180e3230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:53Z,use_quota=True,user_id='5dcea81538b441bc9df600701bb3c9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae433491-2198-40f1-ac67-3ddc88ba4098),volume_type_id=ae433491-2198-40f1-ac67-3ddc88ba4098)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Creating volume 56a6afd2-b85d-4a51-8ddf-07f112560746 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:53 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:53 devstack sudo[87702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746 1073741824
Apr 13 20:31:53 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b83fed9-d085-4075-b006-7c03103115d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '789ddbe0-b045-45ff-820f-2bae074dd059', 'volume_name': 'volume-789ddbe0-b045-45ff-820f-2bae074dd059', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f042ce80>}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fbc25c-fd52-40d5-8b18-0ae1e01a4828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fbc25c-fd52-40d5-8b18-0ae1e01a4828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80714e06-67bf-457e-b69b-edb1a36fc46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:53 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Volume 789ddbe0-b045-45ff-820f-2bae074dd059: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-789ddbe0-b045-45ff-820f-2bae074dd059', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f042ce80>}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Trying to clone 789ddbe0-b045-45ff-820f-2bae074dd059 from image 1af62cce-55dd-41f2-805b-b88f968d7cf0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]). {{(pid=82824) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 20:31:53 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79e0e95-5dd5-4839-81ae-faae84acc3fe]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:53 devstack sudo[87705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD
Apr 13 20:31:53 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:53 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746 1073741824" returned: 0 in 0.716s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:53 devstack sudo[87710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746
Apr 13 20:31:53 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:54 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD" returned: 0 in 0.612s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Temporary image 1af62cce-55dd-41f2-805b-b88f968d7cf0 is fetched for user bab2832bcf524620988b77b20976f87a. {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8569b21-74ab-4f39-803a-95e75a722b97]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:54 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD
Apr 13 20:31:54 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:54 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746" returned: 0 in 0.551s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef236fb-4c76-413f-9e68-6820b4b2f574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a6afd2-b85d-4a51-8ddf-07f112560746', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3b3ef8-004f-487b-a230-0cdb64e588e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:54 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Volume volume-56a6afd2-b85d-4a51-8ddf-07f112560746 (56a6afd2-b85d-4a51-8ddf-07f112560746): created successfully
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3b3ef8-004f-487b-a230-0cdb64e588e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Flow 'volume_create_manager' (ed5a3e74-52ad-4ece-96a4-51b65dcaa381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:54 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5b1d174e-56c9-4131-a4be-e202d434fc7a tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Created volume successfully.
Apr 13 20:31:54 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-551147985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789ddbe0-b045-45ff-820f-2bae074dd059,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:53Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Creating volume 789ddbe0-b045-45ff-820f-2bae074dd059 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:54 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:54 devstack sudo[87721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 1073741824
Apr 13 20:31:54 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:55 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 1073741824" returned: 0 in 0.701s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:55 devstack sudo[87726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059
Apr 13 20:31:55 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e7df90fe-ad67-42ba-ac6a-3d6a517a36cb tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e7df90fe-ad67-42ba-ac6a-3d6a517a36cb tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e7df90fe-ad67-42ba-ac6a-3d6a517a36cb tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e7df90fe-ad67-42ba-ac6a-3d6a517a36cb tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e7df90fe-ad67-42ba-ac6a-3d6a517a36cb tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e7df90fe-ad67-42ba-ac6a-3d6a517a36cb tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:55 devstack sudo[87728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:55 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:56 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059" returned: 0 in 0.644s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Attempting download of 1af62cce-55dd-41f2-805b-b88f968d7cf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}])) to volume 789ddbe0-b045-45ff-820f-2bae074dd059. {{(pid=82824) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[9983a344-d935-470f-a03d-fb94317cf8ce]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_f2ls5tpc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:56 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e7df90fe-ad67-42ba-ac6a-3d6a517a36cb tempest-VolumeRetypeWithoutMigrationTest-119149076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.733s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e7df90fe-ad67-42ba-ac6a-3d6a517a36cb tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:56 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-e7df90fe-ad67-42ba-ac6a-3d6a517a36cb tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Retype volume completed successfully.
Apr 13 20:31:56 devstack sudo[87732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_f2ls5tpc
Apr 13 20:31:56 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:56 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_f2ls5tpc" returned: 0 in 0.745s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_f2ls5tpc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Acquiring lock "cinder-56a6afd2-b85d-4a51-8ddf-07f112560746-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "cinder-56a6afd2-b85d-4a51-8ddf-07f112560746-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Acquiring lock "cinder-quobyte-56a6afd2-b85d-4a51-8ddf-07f112560746" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "cinder-quobyte-56a6afd2-b85d-4a51-8ddf-07f112560746" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:31:56 devstack sudo[87736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_f2ls5tpc
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd85178a-1308-4151-80a1-e248d2041c9d]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:56 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:57 devstack sudo[87738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746
Apr 13 20:31:57 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Flow 'volume_create_manager' (7d92255c-77ec-4465-a433-c68b88def19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86be8ac0-6794-4f3e-902d-aee21368ec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86be8ac0-6794-4f3e-902d-aee21368ec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1201114325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cb7461-ddbc-46bb-bdf1-31e8053f5493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b97fcfd3a443458860114585f8b743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:57Z,use_quota=True,user_id='ac55caa7b9da40bdac02065441c5c5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b5c31b-0e5a-455a-adbe-981a15eaca73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b5c31b-0e5a-455a-adbe-981a15eaca73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d097b0cb-9c9f-4847-a317-c172e5283707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d097b0cb-9c9f-4847-a317-c172e5283707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0cb7461-ddbc-46bb-bdf1-31e8053f5493', 'volume_name': 'volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e62bc0-79af-4d23-8825-4c2b8f95600b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e62bc0-79af-4d23-8825-4c2b8f95600b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220e754a-9aed-45de-9a31-e42372577501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:57 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Volume c0cb7461-ddbc-46bb-bdf1-31e8053f5493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493', 'volume_size': 1}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1201114325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cb7461-ddbc-46bb-bdf1-31e8053f5493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b97fcfd3a443458860114585f8b743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:31:57Z,use_quota=True,user_id='ac55caa7b9da40bdac02065441c5c5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Creating volume c0cb7461-ddbc-46bb-bdf1-31e8053f5493 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:31:57 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:57 devstack sudo[87740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493 1073741824
Apr 13 20:31:57 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:57 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_service.periodic_task [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82824) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746" returned: 0 in 0.647s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:57 devstack sudo[87747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:57 devstack sudo[87748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746
Apr 13 20:31:57 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:57 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:57 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_f2ls5tpc" returned: 1 in 0.834s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0_f2ls5tpc' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09a4ad7-de1f-4bdb-b896-a158550ea3c8]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:31:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:57 devstack sudo[87751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD
Apr 13 20:31:57 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:58 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493 1073741824" returned: 0 in 1.005s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:58 devstack sudo[87758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493
Apr 13 20:31:58 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:58 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.698s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:58 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-56a6afd2-b85d-4a51-8ddf-07f112560746" returned: 0 in 0.752s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "cinder-quobyte-56a6afd2-b85d-4a51-8ddf-07f112560746" released by "delete_volume" :: held 1.451s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:58 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD" returned: 0 in 0.697s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] 1af62cce-55dd-41f2-805b-b88f968d7cf0 was qcow2, converting to raw {{(pid=82824) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:58 devstack cinder-volume[82824]: WARNING cinder.quota [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:31:58 devstack cinder-volume[82824]: WARNING cinder.quota [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Created reservations ['32f137e3-507c-4af3-9c52-f9b85724e1b5', '7fd80cb4-fde8-4758-94cd-1818c769bc3c', '7a49b3b4-1f17-4fcd-88d8-56825f720709', '2230215c-9235-4fdc-a943-66dcee1c1fd9'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:31:58 devstack sudo[87763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059
Apr 13 20:31:58 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:58 devstack sudo[87765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:31:58 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:31:58 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493" returned: 0 in 0.577s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220e754a-9aed-45de-9a31-e42372577501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e9c761-9920-40cd-b6c5-9fc1201f7be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:31:58 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Volume volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493 (c0cb7461-ddbc-46bb-bdf1-31e8053f5493): created successfully
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e9c761-9920-40cd-b6c5-9fc1201f7be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Flow 'volume_create_manager' (7d92255c-77ec-4465-a433-c68b88def19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:31:58 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-783b099e-5ec9-4edf-96b8-954ebdfa7086 tempest-VolumesTransfersV357Test-353819737 None] Created volume successfully.
Apr 13 20:31:58 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.506s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:31:58 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Deleted volume successfully.
Apr 13 20:31:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-133feca3-7933-4415-a4ca-e5ab4e6f27f0 tempest-VolumeRetypeWithoutMigrationTest-119149076 None] Lock "cinder-56a6afd2-b85d-4a51-8ddf-07f112560746-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:31:59 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root
Apr 13 20:31:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059" returned: 0 in 1.253s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:31:59 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_5v75dqcbdevstack@QuobyteHD, size 112.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:31:59 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Converted 112.00 MB image at 89.36 MB/s
Apr 13 20:31:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:31:59 devstack sudo[87776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 1G
Apr 13 20:31:59 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:00 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-7cad7686-b2d7-45ef-b783-096137396dd8 tempest-VolumesTransfersV357Test-133389843 None] Transfer volume completed successfully.
Apr 13 20:32:00 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 1G" returned: 0 in 0.548s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:00 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5252f6-782f-4e27-8a64-cdd2171eed4c]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:00 devstack sudo[87781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059
Apr 13 20:32:00 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:00 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059" returned: 0 in 0.632s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:00 devstack sudo[87788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059
Apr 13 20:32:00 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Acquiring lock "cinder-c0cb7461-ddbc-46bb-bdf1-31e8053f5493-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Lock "cinder-c0cb7461-ddbc-46bb-bdf1-31e8053f5493-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Acquiring lock "cinder-quobyte-c0cb7461-ddbc-46bb-bdf1-31e8053f5493" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Lock "cinder-quobyte-c0cb7461-ddbc-46bb-bdf1-31e8053f5493" acquired by "delete_volume" :: waited 0.034s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0575fe0c-eaea-40b5-87aa-3264ed8b843e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:01 devstack sudo[87791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493
Apr 13 20:32:01 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:01 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059" returned: 1 in 0.674s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Downloaded image 1af62cce-55dd-41f2-805b-b88f968d7cf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}])) to volume 789ddbe0-b045-45ff-820f-2bae074dd059 successfully. {{(pid=82824) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Temporary image 1af62cce-55dd-41f2-805b-b88f968d7cf0 for user bab2832bcf524620988b77b20976f87a is deleted. {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Marking volume 789ddbe0-b045-45ff-820f-2bae074dd059 as bootable. {{(pid=82824) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Copying metadata from image 1af62cce-55dd-41f2-805b-b88f968d7cf0 to 789ddbe0-b045-45ff-820f-2bae074dd059. {{(pid=82824) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Creating volume glance metadata for volume 789ddbe0-b045-45ff-820f-2bae074dd059 backed by image 1af62cce-55dd-41f2-805b-b88f968d7cf0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82824) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80714e06-67bf-457e-b69b-edb1a36fc46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789ddbe0-b045-45ff-820f-2bae074dd059', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f042ce80>}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ba6cef-a2c3-4983-bee2-169b8313fccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:01 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Volume volume-789ddbe0-b045-45ff-820f-2bae074dd059 (789ddbe0-b045-45ff-820f-2bae074dd059): created successfully
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ba6cef-a2c3-4983-bee2-169b8313fccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (3f75624c-287a-4bfa-bb1b-5aa3b23d12af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:01 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-04325a8b-c1bb-43e0-be36-42180fb8a57e tempest-VolumesGetTest-1692548070 None] Created volume successfully.
Apr 13 20:32:01 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493" returned: 0 in 0.567s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:01 devstack sudo[87799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493
Apr 13 20:32:01 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:02 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c0cb7461-ddbc-46bb-bdf1-31e8053f5493" returned: 0 in 0.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Lock "cinder-quobyte-c0cb7461-ddbc-46bb-bdf1-31e8053f5493" released by "delete_volume" :: held 1.076s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Created reservations ['6c6f6eab-9f7b-491f-87c6-c2d1be3c3284', '321899bf-f996-44ba-8908-e0656014013d', '262f96a3-40c6-4cd9-93f7-8ada4364c7a7', '2b0bce2e-16ed-44e5-bfc7-762166c3b43b'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:02 devstack sudo[87802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:02 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (30f80cdd-8a64-4156-88e9-8f7257b232bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3041e38-2e5b-4697-a2b7-14b3276f2874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:02 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3041e38-2e5b-4697-a2b7-14b3276f2874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-57948890',display_name='tempest-VolumesGetTest-Volume-338162101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201dc2e4-ef3a-429d-8c61-1098cb593365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:03Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6c99af-e2aa-4879-8a42-ac7126bcbe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6c99af-e2aa-4879-8a42-ac7126bcbe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716e6e3a-05d3-477c-8aa7-96f90b481cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716e6e3a-05d3-477c-8aa7-96f90b481cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '201dc2e4-ef3a-429d-8c61-1098cb593365', 'volume_name': 'volume-201dc2e4-ef3a-429d-8c61-1098cb593365', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d207992-516a-4ffc-b099-569de78726b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d207992-516a-4ffc-b099-569de78726b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7046fe1-501f-46a4-8d7b-1ca2bfd395b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:02 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Volume 201dc2e4-ef3a-429d-8c61-1098cb593365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-201dc2e4-ef3a-429d-8c61-1098cb593365', 'volume_size': 1}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-57948890',display_name='tempest-VolumesGetTest-Volume-338162101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201dc2e4-ef3a-429d-8c61-1098cb593365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754c078ed5224280acce7e7c8068ef9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:03Z,use_quota=True,user_id='bab2832bcf524620988b77b20976f87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Creating volume 201dc2e4-ef3a-429d-8c61-1098cb593365 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:02 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.558s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:02 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Deleted volume successfully.
Apr 13 20:32:02 devstack sudo[87805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365 1073741824
Apr 13 20:32:02 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:02 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10fe4997-8440-40e0-a8e3-32aad082623c tempest-VolumesTransfersV357Test-1723126327 None] Lock "cinder-c0cb7461-ddbc-46bb-bdf1-31e8053f5493-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Flow 'volume_create_manager' (6afafc86-853b-48ee-92e4-21538ffdf134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9fdf3e-9266-41dc-aef3-58a520c661e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9fdf3e-9266-41dc-aef3-58a520c661e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1949602511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a0e9b4-b718-4e04-b473-7c53df9c3294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263b1bb9f4d34f46a2b0c3a583fa583c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:03Z,use_quota=True,user_id='691647a0053c40158de2f18c82df97da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab2bb5e-78a3-420d-889f-a3968c58c2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab2bb5e-78a3-420d-889f-a3968c58c2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10b7a9c-8506-4c89-96a3-3437881b5263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10b7a9c-8506-4c89-96a3-3437881b5263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a0e9b4-b718-4e04-b473-7c53df9c3294', 'volume_name': 'volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c6a123-c7cd-4ba0-b2e9-4dc412d5da67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c6a123-c7cd-4ba0-b2e9-4dc412d5da67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c8573e-276f-4059-83e0-08e0557b662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:03 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Volume a1a0e9b4-b718-4e04-b473-7c53df9c3294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294', 'volume_size': 1}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:03 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365 1073741824" returned: 0 in 0.536s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:03 devstack sudo[87810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365
Apr 13 20:32:03 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Flow 'volume_create_manager' (cd2b4cc4-392c-4b72-a8f8-8395e2f421e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60c23cb-9f83-4ebf-af2a-e26c9d4e7132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60c23cb-9f83-4ebf-af2a-e26c9d4e7132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-587130184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e3c37b-0342-4b28-b919-091cf1bb93a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b97fcfd3a443458860114585f8b743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:04Z,use_quota=True,user_id='ac55caa7b9da40bdac02065441c5c5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f7a4ea-1730-4646-b863-7c62f7ff6f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f7a4ea-1730-4646-b863-7c62f7ff6f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c23bb67-8ad0-4721-806f-02cc4c65c3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c23bb67-8ad0-4721-806f-02cc4c65c3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e3c37b-0342-4b28-b919-091cf1bb93a7', 'volume_name': 'volume-85e3c37b-0342-4b28-b919-091cf1bb93a7', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092564b6-8500-45fa-ac4b-bba4df811281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092564b6-8500-45fa-ac4b-bba4df811281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ed5c02-1346-433d-b4c5-e7cdafb3aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:03 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Volume 85e3c37b-0342-4b28-b919-091cf1bb93a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e3c37b-0342-4b28-b919-091cf1bb93a7', 'volume_size': 1}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:03 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365" returned: 0 in 0.465s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.731s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1949602511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a0e9b4-b718-4e04-b473-7c53df9c3294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='263b1bb9f4d34f46a2b0c3a583fa583c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:03Z,use_quota=True,user_id='691647a0053c40158de2f18c82df97da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Creating volume a1a0e9b4-b718-4e04-b473-7c53df9c3294 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:03 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7046fe1-501f-46a4-8d7b-1ca2bfd395b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201dc2e4-ef3a-429d-8c61-1098cb593365', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:03 devstack sudo[87813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294 1073741824
Apr 13 20:32:03 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75042db9-a9bd-4cef-9a02-da951db95b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:03 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Volume volume-201dc2e4-ef3a-429d-8c61-1098cb593365 (201dc2e4-ef3a-429d-8c61-1098cb593365): created successfully
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75042db9-a9bd-4cef-9a02-da951db95b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:03 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Flow 'volume_create_manager' (30f80cdd-8a64-4156-88e9-8f7257b232bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:03 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8b99e1ff-6b0f-46eb-af8d-88836c6f37b7 tempest-VolumesGetTest-1692548070 None] Created volume successfully.
Apr 13 20:32:04 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294 1073741824" returned: 0 in 0.486s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:04 devstack sudo[87818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294
Apr 13 20:32:04 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:04 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294" returned: 0 in 0.439s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.026s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-587130184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e3c37b-0342-4b28-b919-091cf1bb93a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b97fcfd3a443458860114585f8b743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:04Z,use_quota=True,user_id='ac55caa7b9da40bdac02065441c5c5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Creating volume 85e3c37b-0342-4b28-b919-091cf1bb93a7 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:04 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c8573e-276f-4059-83e0-08e0557b662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346c5927-b1cd-477b-9542-df4231368771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:04 devstack sudo[87821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7 1073741824
Apr 13 20:32:04 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:04 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Volume volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294 (a1a0e9b4-b718-4e04-b473-7c53df9c3294): created successfully
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346c5927-b1cd-477b-9542-df4231368771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Flow 'volume_create_manager' (6afafc86-853b-48ee-92e4-21538ffdf134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:04 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-53808d46-8544-409e-a79d-b3ba051b8490 tempest-VolumesServicesTestJSON-1897278386 None] Created volume successfully.
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-201dc2e4-ef3a-429d-8c61-1098cb593365-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Lock "cinder-201dc2e4-ef3a-429d-8c61-1098cb593365-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-quobyte-201dc2e4-ef3a-429d-8c61-1098cb593365" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-201dc2e4-ef3a-429d-8c61-1098cb593365" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59c1680-447f-4a31-92c6-b50fd3efb084]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:05 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365
Apr 13 20:32:05 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Acquiring lock "cinder-a1a0e9b4-b718-4e04-b473-7c53df9c3294-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Lock "cinder-a1a0e9b4-b718-4e04-b473-7c53df9c3294-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Acquiring lock "cinder-quobyte-a1a0e9b4-b718-4e04-b473-7c53df9c3294" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Lock "cinder-quobyte-a1a0e9b4-b718-4e04-b473-7c53df9c3294" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef26fee-0471-4999-bf11-6ee79ad76e38]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:05 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294
Apr 13 20:32:05 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:05 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7 1073741824" returned: 0 in 0.782s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:05 devstack sudo[87830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7
Apr 13 20:32:05 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:05 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365" returned: 0 in 0.711s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:05 devstack sudo[87835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365
Apr 13 20:32:05 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:06 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294" returned: 0 in 0.584s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:06 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294
Apr 13 20:32:06 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:06 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7" returned: 0 in 0.571s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ed5c02-1346-433d-b4c5-e7cdafb3aa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e3c37b-0342-4b28-b919-091cf1bb93a7', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ab35c0-3b74-43ce-b3b5-2ad34e1af77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:06 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Volume volume-85e3c37b-0342-4b28-b919-091cf1bb93a7 (85e3c37b-0342-4b28-b919-091cf1bb93a7): created successfully
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ab35c0-3b74-43ce-b3b5-2ad34e1af77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Flow 'volume_create_manager' (cd2b4cc4-392c-4b72-a8f8-8395e2f421e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:06 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d38dc770-1b36-4005-81aa-35f6486f156f tempest-VolumesTransfersV357Test-353819737 None] Created volume successfully.
Apr 13 20:32:06 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-201dc2e4-ef3a-429d-8c61-1098cb593365" returned: 0 in 0.568s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-201dc2e4-ef3a-429d-8c61-1098cb593365" released by "delete_volume" :: held 1.325s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Created reservations ['565a98d2-c032-4978-9250-8c90fc134748', '9b1e4348-5395-42fb-b6e8-c6d3a845c8ac', 'c3a72bf2-a9b1-4c58-adaa-209f40ad7d7d', '03129c41-21c9-4915-bf04-48682b47ed23'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:06 devstack sudo[87846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:06 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:06 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a1a0e9b4-b718-4e04-b473-7c53df9c3294" returned: 0 in 0.540s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Lock "cinder-quobyte-a1a0e9b4-b718-4e04-b473-7c53df9c3294" released by "delete_volume" :: held 1.159s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Created reservations ['f0f76cef-75a9-45c2-b9c1-de871e8c33d3', 'b8a68102-2e4c-4248-841e-9e32100e1af8', '44a425f4-4251-4e33-92fc-74098cd9850b', '44df4a44-a9ca-4071-b361-e763c0c277b6'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:06 devstack sudo[87848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:06 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:06 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.463s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:06 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:07 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Deleted volume successfully.
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-847f71ea-6917-4ad1-9519-51b10a4e3c61 tempest-VolumesGetTest-1692548070 None] Lock "cinder-201dc2e4-ef3a-429d-8c61-1098cb593365-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Acquiring lock "cinder-85e3c37b-0342-4b28-b919-091cf1bb93a7-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:07 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Lock "cinder-85e3c37b-0342-4b28-b919-091cf1bb93a7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.522s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:07 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Deleted volume successfully.
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fd5b919-bfaf-4779-bda1-2fc1dd504907 tempest-VolumesServicesTestJSON-1897278386 None] Lock "cinder-a1a0e9b4-b718-4e04-b473-7c53df9c3294-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Acquiring lock "cinder-quobyte-85e3c37b-0342-4b28-b919-091cf1bb93a7" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Lock "cinder-quobyte-85e3c37b-0342-4b28-b919-091cf1bb93a7" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e41ce11-20ff-49a1-ab5a-b701571c8bb2]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:07 devstack sudo[87867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7
Apr 13 20:32:07 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-789ddbe0-b045-45ff-820f-2bae074dd059-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Lock "cinder-789ddbe0-b045-45ff-820f-2bae074dd059-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Acquiring lock "cinder-quobyte-789ddbe0-b045-45ff-820f-2bae074dd059" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-789ddbe0-b045-45ff-820f-2bae074dd059" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c2d491-07d5-4c35-aa44-ba005c6b60d1]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:07 devstack sudo[87869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059
Apr 13 20:32:07 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:07 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7" returned: 0 in 0.589s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:07 devstack sudo[87874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7
Apr 13 20:32:07 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:08 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059" returned: 0 in 0.576s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:08 devstack sudo[87878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059
Apr 13 20:32:08 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:08 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-85e3c37b-0342-4b28-b919-091cf1bb93a7" returned: 0 in 0.510s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Lock "cinder-quobyte-85e3c37b-0342-4b28-b919-091cf1bb93a7" released by "delete_volume" :: held 1.122s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Created reservations ['549ae7ed-ea38-43b4-82ee-7c3cf6fa8d84', 'af7c1c21-9b83-4b95-a280-7b2e92572d15', '45b90fa9-3576-4154-bc3c-7630382ee62b', 'adf3864b-f29d-4645-bad8-0d1d03161c95'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:08 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:08 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:08 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059" returned: 1 in 0.621s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:08 devstack sudo[87886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059
Apr 13 20:32:08 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:08 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.490s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:08 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Deleted volume successfully.
Apr 13 20:32:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ba068aae-dc24-4de5-b0d7-030fc7b6af9f tempest-VolumesTransfersV357Test-1723126327 None] Lock "cinder-85e3c37b-0342-4b28-b919-091cf1bb93a7-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:09 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-789ddbe0-b045-45ff-820f-2bae074dd059" returned: 0 in 0.505s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Lock "cinder-quobyte-789ddbe0-b045-45ff-820f-2bae074dd059" released by "delete_volume" :: held 1.748s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Created reservations ['fe379cd4-f59a-4601-9f45-521b358a3e87', 'b7a43fa6-c254-4205-bb7e-9d9abe252d63', '5db49c51-e0e4-4a03-932c-fef236c73753', 'eb4bc9bb-b689-48ca-96bb-c83d91b7270d'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:09 devstack sudo[87891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:09 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:09 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.477s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:09 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Deleted volume successfully.
Apr 13 20:32:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7b30b108-7ffe-4060-b3ba-dda4df697fff tempest-VolumesGetTest-1692548070 None] Lock "cinder-789ddbe0-b045-45ff-820f-2bae074dd059-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=170,cinder:INSERT=53,cinder:UPDATE=216,cinder:DELETE=18 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=173,cinder:UPDATE=218,cinder:INSERT=70,cinder:DELETE=14 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Flow 'volume_create_manager' (cf03b1e5-eae3-4953-961d-e516d8ca536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792c39a5-e3df-495b-8122-cf02a458f441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792c39a5-e3df-495b-8122-cf02a458f441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1882072925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ad8c1fe88945fc85a989b490fd7a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:13Z,use_quota=True,user_id='4e5b659622c7413faa49439fdd0a0203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc69e9de-13d8-4478-9671-c9e330579849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc69e9de-13d8-4478-9671-c9e330579849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53211227-3b7f-4093-80f9-2764f84e7ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53211227-3b7f-4093-80f9-2764f84e7ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb', 'volume_name': 'volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb', 'volume_size': 2}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64f8b36-78f0-43d7-8dfd-e26ba1a9aeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64f8b36-78f0-43d7-8dfd-e26ba1a9aeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54bdca2-05e8-46b6-bfb9-28a021d9cf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:13 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Volume 3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb', 'volume_size': 2}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1882072925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ad8c1fe88945fc85a989b490fd7a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:13Z,use_quota=True,user_id='4e5b659622c7413faa49439fdd0a0203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Creating volume 3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:13 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb 2147483648 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:13 devstack sudo[87938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb 2147483648
Apr 13 20:32:13 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:14 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb 2147483648" returned: 0 in 0.689s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:14 devstack sudo[87943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb
Apr 13 20:32:14 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:15 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb" returned: 0 in 0.973s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54bdca2-05e8-46b6-bfb9-28a021d9cf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb', 'volume_size': 2}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6d4d70-f905-475c-8962-6b5679177982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:15 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Volume volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb (3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb): created successfully
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6d4d70-f905-475c-8962-6b5679177982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Flow 'volume_create_manager' (cf03b1e5-eae3-4953-961d-e516d8ca536f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:15 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6dfb3300-bbad-4f2a-8e53-f34052ffe3c4 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Created volume successfully.
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Flow 'volume_create_manager' (0acc5094-2f34-4ba9-8759-ab803031e245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3e9b15-9c17-4245-9ebe-7e76e8bc7851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3e9b15-9c17-4245-9ebe-7e76e8bc7851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1769121015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae5a11f-c3e0-4586-bb0c-71532b4eb73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3539f3fdca15419fb6b68c3123dfa472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:15Z,use_quota=True,user_id='ab948b8c7f3943e6aa1b24a171b6657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f62ca0-d7c9-486c-a124-648637835ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f62ca0-d7c9-486c-a124-648637835ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f84dc6-9c36-45a7-9fba-f40a41c1095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.image.glance [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Creating Keystone auth plugin from conf {{(pid=82824) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (ef1fe6fc-62d7-45c4-9c1d-8cc34a30bdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ad349d-38dd-45ab-8cad-55f42549b138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ad349d-38dd-45ab-8cad-55f42549b138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1465834850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d886bb8e-31fc-4b73-ba57-f4cabdfd27b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:15Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5424a62c-ab11-430b-8f84-5a3fc86265c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5424a62c-ab11-430b-8f84-5a3fc86265c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46880def-5802-4d67-b8a6-5fe4cd0ebf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46880def-5802-4d67-b8a6-5fe4cd0ebf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd886bb8e-31fc-4b73-ba57-f4cabdfd27b5', 'volume_name': 'volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ea85a7-f741-4332-9509-46ae4c548586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ea85a7-f741-4332-9509-46ae4c548586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd77786-ba7b-42a1-82bc-74aaa89ecaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:15 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Volume d886bb8e-31fc-4b73-ba57-f4cabdfd27b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5', 'volume_size': 1}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1465834850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d886bb8e-31fc-4b73-ba57-f4cabdfd27b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:15Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Creating volume d886bb8e-31fc-4b73-ba57-f4cabdfd27b5 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:15 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:15 devstack sudo[87966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5 1073741824
Apr 13 20:32:15 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f84dc6-9c36-45a7-9fba-f40a41c1095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ae5a11f-c3e0-4586-bb0c-71532b4eb73a', 'volume_name': 'volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f047aec0>}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea727b0-14eb-4c7c-bc96-97315dea398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea727b0-14eb-4c7c-bc96-97315dea398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7784726a-1a11-4b3a-86ab-8192e34030c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:15 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Volume 4ae5a11f-c3e0-4586-bb0c-71532b4eb73a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f047aec0>}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Trying to clone 4ae5a11f-c3e0-4586-bb0c-71532b4eb73a from image 1af62cce-55dd-41f2-805b-b88f968d7cf0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]). {{(pid=82824) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 20:32:15 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0590d40d-a7d8-40bf-b13a-ac5095fa06ed]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:16 devstack sudo[87983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD
Apr 13 20:32:16 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:16 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5 1073741824" returned: 0 in 0.793s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:16 devstack sudo[87988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5
Apr 13 20:32:16 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:16 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD" returned: 0 in 0.612s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Temporary image 1af62cce-55dd-41f2-805b-b88f968d7cf0 is fetched for user ab948b8c7f3943e6aa1b24a171b6657a. {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1a5bf6-3bd7-4fd8-9549-f65e5691599f]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:16 devstack sudo[87993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD
Apr 13 20:32:16 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:16 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5" returned: 0 in 0.576s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.324s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Creating offline snapshot 4f133377-d039-466e-a190-930ec280b301 of volume 3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd77786-ba7b-42a1-82bc-74aaa89ecaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f967b162-3346-4a7d-96e2-7e67257922c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0265a942-2b53-441a-b677-6394889f4386]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:16 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Volume volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5 (d886bb8e-31fc-4b73-ba57-f4cabdfd27b5): created successfully
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f967b162-3346-4a7d-96e2-7e67257922c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (ef1fe6fc-62d7-45c4-9c1d-8cc34a30bdcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:16 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-4dd08a60-5c58-4ff1-852f-2f99972b708e tempest-VolumesActionsTest-358394727 None] Created volume successfully.
Apr 13 20:32:17 devstack sudo[87996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb
Apr 13 20:32:17 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:17 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD" returned: 0 in 0.581s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-71ac2089-d674-46b3-bb20-1e10c60d2578 tempest-VolumesActionsTest-358394727 None] Acquiring lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5" by "attach_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-71ac2089-d674-46b3-bb20-1e10c60d2578 tempest-VolumesActionsTest-358394727 None] Lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5" acquired by "attach_volume" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:17 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-71ac2089-d674-46b3-bb20-1e10c60d2578 tempest-VolumesActionsTest-358394727 None] Attaching volume d886bb8e-31fc-4b73-ba57-f4cabdfd27b5 to instance c76a7682-2aad-4eb3-929a-43fecc7f24f7 at mountpoint /dev/vdb on host None.
Apr 13 20:32:17 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-71ac2089-d674-46b3-bb20-1e10c60d2578 tempest-VolumesActionsTest-358394727 None] Attach volume completed successfully.
Apr 13 20:32:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-71ac2089-d674-46b3-bb20-1e10c60d2578 tempest-VolumesActionsTest-358394727 None] Lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5" released by "attach_volume" :: held 0.093s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:17 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb" returned: 0 in 0.651s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301 2G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:17 devstack sudo[88004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301 2G
Apr 13 20:32:17 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:18 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301 2G" returned: 0 in 0.603s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:18 devstack sudo[88009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301
Apr 13 20:32:18 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:18 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-58e5337b-f382-4955-b967-f270e04d28ca tempest-VolumesActionsTest-924411195 None] Terminate volume connection completed successfully.
Apr 13 20:32:18 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301" returned: 0 in 0.540s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:18 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301 is being set with open permissions: ugo+rw
Apr 13 20:32:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:18 devstack sudo[88014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301
Apr 13 20:32:18 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-58e5337b-f382-4955-b967-f270e04d28ca tempest-VolumesActionsTest-924411195 None] Acquiring lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5-detach_volume" by "detach_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-58e5337b-f382-4955-b967-f270e04d28ca tempest-VolumesActionsTest-924411195 None] Lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:18 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-58e5337b-f382-4955-b967-f270e04d28ca tempest-VolumesActionsTest-924411195 None] Detaching volume d886bb8e-31fc-4b73-ba57-f4cabdfd27b5 from instance c76a7682-2aad-4eb3-929a-43fecc7f24f7.
Apr 13 20:32:19 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-58e5337b-f382-4955-b967-f270e04d28ca tempest-VolumesActionsTest-924411195 None] Detach volume completed successfully.
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-58e5337b-f382-4955-b967-f270e04d28ca tempest-VolumesActionsTest-924411195 None] Lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:19 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301" returned: 0 in 0.493s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:19 devstack sudo[88018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.info
Apr 13 20:32:19 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Flow 'volume_create_manager' (92e973c5-6fb3-4d70-9854-b230d17865fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67debc7-756c-404e-9d35-4f5c227ebe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3aed189a-79eb-4ca8-85e1-632d5513384d tempest-VolumesActionsTest-358394727 None] Acquiring lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5-detach_volume" by "detach_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67debc7-756c-404e-9d35-4f5c227ebe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-297863097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efba309-6b53-4351-b5e8-ccfeb067cfac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a58489464240f9a03b7eca1e1f9f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:20Z,use_quota=True,user_id='28bf2277e9544d1fbc0aaa02de138df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2fa61f-7cde-42e0-9188-d878450177d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2fa61f-7cde-42e0-9188-d878450177d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9671417-5e80-44b0-a974-eeeb085adf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9671417-5e80-44b0-a974-eeeb085adf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0efba309-6b53-4351-b5e8-ccfeb067cfac', 'volume_name': 'volume-0efba309-6b53-4351-b5e8-ccfeb067cfac', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e753f7b-049b-4267-ab62-a4a0c6c46833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e753f7b-049b-4267-ab62-a4a0c6c46833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b48a7d4-6ae4-45bd-bb86-aed6b21be009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:19 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Volume 0efba309-6b53-4351-b5e8-ccfeb067cfac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0efba309-6b53-4351-b5e8-ccfeb067cfac', 'volume_size': 1}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3aed189a-79eb-4ca8-85e1-632d5513384d tempest-VolumesActionsTest-358394727 None] Lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:19 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3aed189a-79eb-4ca8-85e1-632d5513384d tempest-VolumesActionsTest-358394727 None] Volume detach called, but volume not attached.
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3aed189a-79eb-4ca8-85e1-632d5513384d tempest-VolumesActionsTest-358394727 None] Lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5-detach_volume" released by "detach_volume" :: held 0.012s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:19 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.info" returned: 0 in 0.520s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:19 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.info is being set with open permissions: ugo+rw
Apr 13 20:32:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:19 devstack sudo[88021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.info
Apr 13 20:32:19 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:20 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.info" returned: 0 in 0.447s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.331s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.983s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1769121015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae5a11f-c3e0-4586-bb0c-71532b4eb73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3539f3fdca15419fb6b68c3123dfa472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:15Z,use_quota=True,user_id='ab948b8c7f3943e6aa1b24a171b6657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Creating volume 4ae5a11f-c3e0-4586-bb0c-71532b4eb73a {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:20 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:20 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f68d3613-9605-4d54-b250-f24fb88fc7d0 tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Create snapshot completed successfully
Apr 13 20:32:20 devstack sudo[88024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a 1073741824
Apr 13 20:32:20 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Acquiring lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Acquiring lock "cinder-quobyte-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Lock "cinder-quobyte-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9931b62-b043-4c17-b583-ad6498e3ca64]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:20 devstack sudo[88026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5
Apr 13 20:32:20 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Acquiring lock "cinder-4f133377-d039-466e-a190-930ec280b301-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "cinder-4f133377-d039-466e-a190-930ec280b301-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Acquiring lock "cinder-quobyte-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "cinder-quobyte-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Acquiring lock "cinder-quobyte-4f133377-d039-466e-a190-930ec280b301" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "cinder-quobyte-4f133377-d039-466e-a190-930ec280b301" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Deleting offline snapshot 4f133377-d039-466e-a190-930ec280b301 of volume 3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] snapshot_file for this snap is: volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c69012b-4f9a-4f72-9404-06b27ca04d71]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:20 devstack sudo[88031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301
Apr 13 20:32:20 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:20 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a 1073741824" returned: 0 in 0.667s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:20 devstack sudo[88036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a
Apr 13 20:32:20 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:20 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5" returned: 0 in 0.569s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:21 devstack sudo[88038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5
Apr 13 20:32:21 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:21 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301" returned: 0 in 0.519s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[223945ea-6536-457d-b704-b31c27919e98]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:21 devstack sudo[88044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb
Apr 13 20:32:21 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:21 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" returned: 0 in 0.458s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.707s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-297863097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efba309-6b53-4351-b5e8-ccfeb067cfac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a58489464240f9a03b7eca1e1f9f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:20Z,use_quota=True,user_id='28bf2277e9544d1fbc0aaa02de138df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Creating volume 0efba309-6b53-4351-b5e8-ccfeb067cfac {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:21 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:21 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5" returned: 0 in 0.450s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:21 devstack sudo[88047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac 1073741824
Apr 13 20:32:21 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Lock "cinder-quobyte-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5" released by "delete_volume" :: held 1.053s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Attempting download of 1af62cce-55dd-41f2-805b-b88f968d7cf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}])) to volume 4ae5a11f-c3e0-4586-bb0c-71532b4eb73a. {{(pid=82824) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Created reservations ['fde88c44-a782-4a37-a47d-cc89fcbf9841', '867dd5cb-6ae2-40d0-9d2b-82abe33a8722', 'cc1679c6-7053-4494-ac32-d2a0d40d29bb', 'c9af35c7-6758-4b79-aa8a-83cb9c3737c1'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed82294-89d3-4120-803f-ef08e47cfabe]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0__mjd0_st {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:21 devstack sudo[88050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:21 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:21 devstack sudo[88049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0__mjd0_st
Apr 13 20:32:21 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:22 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:22 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.505s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb" returned: 0 in 0.756s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:22 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Deleted volume successfully.
Apr 13 20:32:22 devstack sudo[88060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301
Apr 13 20:32:22 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-69de4090-f9b3-4780-9217-c8ce9ec17c1e tempest-VolumesActionsTest-358394727 None] Lock "cinder-d886bb8e-31fc-4b73-ba57-f4cabdfd27b5-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:22 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0__mjd0_st" returned: 0 in 0.671s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0__mjd0_st {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:22 devstack sudo[88064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0__mjd0_st
Apr 13 20:32:22 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:22 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac 1073741824" returned: 0 in 0.855s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:22 devstack sudo[88066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac
Apr 13 20:32:22 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:22 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301" returned: 0 in 0.564s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:22 devstack sudo[88072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301
Apr 13 20:32:22 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:22 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac" returned: 0 in 0.530s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b48a7d4-6ae4-45bd-bb86-aed6b21be009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0efba309-6b53-4351-b5e8-ccfeb067cfac', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62727056-8cd4-475c-87cf-f4ea025a5cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:22 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Volume volume-0efba309-6b53-4351-b5e8-ccfeb067cfac (0efba309-6b53-4351-b5e8-ccfeb067cfac): created successfully
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62727056-8cd4-475c-87cf-f4ea025a5cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Flow 'volume_create_manager' (92e973c5-6fb3-4d70-9854-b230d17865fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:22 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-76f894ab-2358-40db-b0f4-39360eee970a tempest-SnapshotMetadataTestJSON-1829829520 None] Created volume successfully.
Apr 13 20:32:22 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0__mjd0_st" returned: 1 in 0.715s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af62cce-55dd-41f2-805b-b88f968d7cf0__mjd0_st' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5916c08a-5835-45ad-9176-671a5645de6b]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:22 devstack sudo[88077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD
Apr 13 20:32:22 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:23 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb.4f133377-d039-466e-a190-930ec280b301" returned: 0 in 0.593s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "cinder-quobyte-4f133377-d039-466e-a190-930ec280b301" released by "_delete_snapshot" :: held 2.492s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "cinder-quobyte-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb" released by "delete_snapshot" :: held 2.507s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:23 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Created reservations ['9923589c-845a-4c72-beb1-cc8e72f27dfa', 'dad2f206-fa17-4ab2-a504-45d6d0bc7bce', 'bcf52f1a-6068-4928-9592-3163be74e38b', '639e4dd8-95c8-4df0-8b82-9f660a7469be'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:23 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Delete snapshot completed successfully.
Apr 13 20:32:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fe9fb1b2-50cf-4ca9-b48e-97269dfb308b tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "cinder-4f133377-d039-466e-a190-930ec280b301-delete_snapshot" released by "delete_snapshot" :: held 2.594s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:23 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD" returned: 0 in 0.504s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:23 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] 1af62cce-55dd-41f2-805b-b88f968d7cf0 was qcow2, converting to raw {{(pid=82824) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 20:32:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:23 devstack sudo[88083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a
Apr 13 20:32:23 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Acquiring lock "cinder-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "cinder-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Acquiring lock "cinder-quobyte-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "cinder-quobyte-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb" acquired by "delete_volume" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f1f223-256c-4b18-a3e5-1be3b9df21b0]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] Creating offline snapshot 8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb of volume 0efba309-6b53-4351-b5e8-ccfeb067cfac {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5431ffa3-9719-482b-9b63-1d182c320087]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:24 devstack sudo[88120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb
Apr 13 20:32:24 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:24 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac
Apr 13 20:32:24 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:24 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" returned: 0 in 1.087s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1af62cce-55dd-41f2-805b-b88f968d7cf0_no4xfyuddevstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:32:24 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Converted 112.00 MB image at 102.87 MB/s
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:24 devstack sudo[88124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a 1G
Apr 13 20:32:24 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:24 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb" returned: 0 in 0.563s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:24 devstack sudo[88132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb
Apr 13 20:32:24 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:24 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac" returned: 0 in 0.564s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:24 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb 1G
Apr 13 20:32:24 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:24 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a 1G" returned: 0 in 0.493s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db3fbf1-6f7a-44a2-ac68-3c5e20e137f0]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:25 devstack sudo[88140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a
Apr 13 20:32:25 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:25 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb" returned: 0 in 0.497s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "cinder-quobyte-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb" released by "delete_volume" :: held 1.114s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Created reservations ['f81cadc4-3ad0-43b6-9b3d-aa2ffe625b1c', 'c5c4e788-20c5-4f1c-a5ba-9865a4916fdf', '615ff498-424a-4f84-b666-b0c0acf125ae', 'a67eb351-6d1d-4173-8ab4-7efb604604be'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:25 devstack sudo[88146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:25 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:25 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb 1G" returned: 0 in 0.611s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0efba309-6b53-4351-b5e8-ccfeb067cfac -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:25 devstack sudo[88149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0efba309-6b53-4351-b5e8-ccfeb067cfac -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb
Apr 13 20:32:25 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:25 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" returned: 0 in 0.557s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:25 devstack sudo[88153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a
Apr 13 20:32:25 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:25 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.464s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:25 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Deleted volume successfully.
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6da01368-e726-463b-947d-2fc2a37fa9ca tempest-VolumesSnapshotNegativeTestJSON-2113097133 None] Lock "cinder-3fc44079-ee7b-4d0c-9e22-1dc52e23c0eb-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:25 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0efba309-6b53-4351-b5e8-ccfeb067cfac -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb" returned: 0 in 0.466s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:25 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb is being set with open permissions: ugo+rw
Apr 13 20:32:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:25 devstack sudo[88159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb
Apr 13 20:32:25 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:26 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" returned: 1 in 0.493s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Downloaded image 1af62cce-55dd-41f2-805b-b88f968d7cf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}])) to volume 4ae5a11f-c3e0-4586-bb0c-71532b4eb73a successfully. {{(pid=82824) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Temporary image 1af62cce-55dd-41f2-805b-b88f968d7cf0 for user ab948b8c7f3943e6aa1b24a171b6657a is deleted. {{(pid=82824) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG cinder.volume.volume_utils [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Marking volume 4ae5a11f-c3e0-4586-bb0c-71532b4eb73a as bootable. {{(pid=82824) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Copying metadata from image 1af62cce-55dd-41f2-805b-b88f968d7cf0 to 4ae5a11f-c3e0-4586-bb0c-71532b4eb73a. {{(pid=82824) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Creating volume glance metadata for volume 4ae5a11f-c3e0-4586-bb0c-71532b4eb73a backed by image 1af62cce-55dd-41f2-805b-b88f968d7cf0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82824) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7784726a-1a11-4b3a-86ab-8192e34030c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a', 'volume_size': 1, 'image_id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af62cce-55dd-41f2-805b-b88f968d7cf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02124723c9164d1395526e687a688468', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1af62cce-55dd-41f2-805b-b88f968d7cf0', 'created_at': datetime.datetime(2026, 4, 13, 18, 23, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 18, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af62cce-55dd-41f2-805b-b88f968d7cf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f37f047aec0>}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3cd488-7361-47b8-8d3d-1e0ca8c3783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:26 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Volume volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a (4ae5a11f-c3e0-4586-bb0c-71532b4eb73a): created successfully
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3cd488-7361-47b8-8d3d-1e0ca8c3783b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Flow 'volume_create_manager' (0acc5094-2f34-4ba9-8759-ab803031e245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:26 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5d4a608b-d2bb-4411-b05b-71ce2952d46a tempest-VolumesExtendTest-1341728462 None] Created volume successfully.
Apr 13 20:32:26 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb" returned: 0 in 0.447s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:26 devstack sudo[88165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.info
Apr 13 20:32:26 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:26 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.info" returned: 0 in 0.469s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:26 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.info is being set with open permissions: ugo+rw
Apr 13 20:32:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:26 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.info
Apr 13 20:32:26 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24127d39-37f5-46f5-a5c4-1856f3386de7 tempest-VolumesExtendTest-1341728462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:27 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.info" returned: 0 in 0.499s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24127d39-37f5-46f5-a5c4-1856f3386de7 tempest-VolumesExtendTest-1341728462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.146s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:27 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c9edafc3-e05e-4548-a784-f7724f83d74c tempest-SnapshotMetadataTestJSON-1829829520 None] Create snapshot completed successfully
Apr 13 20:32:27 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[b504cd5c-2668-4641-9509-5fc724013e67]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24127d39-37f5-46f5-a5c4-1856f3386de7 tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:27 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a
Apr 13 20:32:27 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:27 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24127d39-37f5-46f5-a5c4-1856f3386de7 tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" returned: 0 in 0.544s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24127d39-37f5-46f5-a5c4-1856f3386de7 tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:27 devstack sudo[88176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a
Apr 13 20:32:27 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Flow 'volume_create_manager' (3efebc7f-2d11-47ca-afd6-640f649ec9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47409c8-394e-46bb-9fe2-e9bb821401fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47409c8-394e-46bb-9fe2-e9bb821401fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392154762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df975855-bb2f-45ba-bb73-e664b4858e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ebbcd8d5f64c2d90dde19be2bf00aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:28Z,use_quota=True,user_id='f30fcba6b9394f9a84809b293008677e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be9131a-1098-42c2-86d5-97624694be90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be9131a-1098-42c2-86d5-97624694be90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bd1d1d-64b6-4980-8c2b-417cef97d76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bd1d1d-64b6-4980-8c2b-417cef97d76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df975855-bb2f-45ba-bb73-e664b4858e1c', 'volume_name': 'volume-df975855-bb2f-45ba-bb73-e664b4858e1c', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4899b7-96f2-4404-9502-c923b3c83f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4899b7-96f2-4404-9502-c923b3c83f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bad796c-6c21-49dc-be01-bafe772afbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Volume df975855-bb2f-45ba-bb73-e664b4858e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df975855-bb2f-45ba-bb73-e664b4858e1c', 'volume_size': 1}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Flow 'volume_create_manager' (6f4b6744-e5cc-4c00-8d09-74558e8f0910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc21857-57f8-4784-99a2-e4663f3736a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc21857-57f8-4784-99a2-e4663f3736a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1233672856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8811e0-d6d0-44eb-961f-8d27a4ef76b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ebbcd8d5f64c2d90dde19be2bf00aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:28Z,use_quota=True,user_id='f30fcba6b9394f9a84809b293008677e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5503f58-5dc8-4eb6-ae11-d6065acdcfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5503f58-5dc8-4eb6-ae11-d6065acdcfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9aed86-a41a-4857-8c86-41cc6f7b7fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9aed86-a41a-4857-8c86-41cc6f7b7fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c8811e0-d6d0-44eb-961f-8d27a4ef76b6', 'volume_name': 'volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7540616-bdcf-47e6-adef-5751a01c60a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7540616-bdcf-47e6-adef-5751a01c60a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b046b859-09cc-4628-9285-3157b0fd840a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Volume 4c8811e0-d6d0-44eb-961f-8d27a4ef76b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6', 'volume_size': 1}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:28 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Flow 'volume_create_manager' (38d5f266-c26c-4d60-9ecb-da15bdf36556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a45631d-117a-484e-b96c-322c19f1de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24127d39-37f5-46f5-a5c4-1856f3386de7 tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" returned: 1 in 0.601s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24127d39-37f5-46f5-a5c4-1856f3386de7 tempest-VolumesExtendTest-1341728462 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24127d39-37f5-46f5-a5c4-1856f3386de7 tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a 2G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a45631d-117a-484e-b96c-322c19f1de78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-710215279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6af77a-3d13-49cf-9db3-9b29eea13026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ebbcd8d5f64c2d90dde19be2bf00aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:28Z,use_quota=True,user_id='f30fcba6b9394f9a84809b293008677e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699b8c74-e871-438a-aa31-122413ab308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699b8c74-e871-438a-aa31-122413ab308f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74193352-089e-4966-8a1c-130f29f0a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74193352-089e-4966-8a1c-130f29f0a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b6af77a-3d13-49cf-9db3-9b29eea13026', 'volume_name': 'volume-3b6af77a-3d13-49cf-9db3-9b29eea13026', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe29175-639b-4e97-a5cc-19ddfab5f68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe29175-639b-4e97-a5cc-19ddfab5f68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afeabee7-2d53-4855-8412-daa93fe5cf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Volume 3b6af77a-3d13-49cf-9db3-9b29eea13026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b6af77a-3d13-49cf-9db3-9b29eea13026', 'volume_size': 1}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-24127d39-37f5-46f5-a5c4-1856f3386de7 tempest-VolumesExtendTest-1341728462 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a 2G" returned: 0 in 0.065s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-24127d39-37f5-46f5-a5c4-1856f3386de7 tempest-VolumesExtendTest-1341728462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.251s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392154762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df975855-bb2f-45ba-bb73-e664b4858e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ebbcd8d5f64c2d90dde19be2bf00aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:28Z,use_quota=True,user_id='f30fcba6b9394f9a84809b293008677e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Creating volume df975855-bb2f-45ba-bb73-e664b4858e1c {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:28 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:28 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-24127d39-37f5-46f5-a5c4-1856f3386de7 tempest-VolumesExtendTest-1341728462 None] Extend volume completed successfully.
Apr 13 20:32:28 devstack sudo[88185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c 1073741824
Apr 13 20:32:28 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Flow 'volume_create_manager' (85e5aac5-224b-4d49-a41e-e562f41f14ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1cee1ea-f9c9-4adf-a6a5-ee183ebf4576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1cee1ea-f9c9-4adf-a6a5-ee183ebf4576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1928018403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0a0a8c-47b3-465b-af3f-8a0bb6a31013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ebbcd8d5f64c2d90dde19be2bf00aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:29Z,use_quota=True,user_id='f30fcba6b9394f9a84809b293008677e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b14f3f-e38a-4a8d-bfe0-e98e74e3fc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b14f3f-e38a-4a8d-bfe0-e98e74e3fc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2350a2a4-8cf3-4864-bcdf-e1ddc2bf6ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2350a2a4-8cf3-4864-bcdf-e1ddc2bf6ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0a0a8c-47b3-465b-af3f-8a0bb6a31013', 'volume_name': 'volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95842293-1f7f-41c9-8d10-bca3817957ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95842293-1f7f-41c9-8d10-bca3817957ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8332e4f-baf3-41ea-8b89-a8699c8883db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Volume 8d0a0a8c-47b3-465b-af3f-8a0bb6a31013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013', 'volume_size': 1}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Flow 'volume_create_manager' (b9c02c5b-db65-4cb5-8dfd-3d434ac604db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886eded5-aa07-44b0-8214-64a9b770a47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Acquiring lock "cinder-8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886eded5-aa07-44b0-8214-64a9b770a47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780942835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1fd5cd-e1a4-48f1-ac7b-481025bb9476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ebbcd8d5f64c2d90dde19be2bf00aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:29Z,use_quota=True,user_id='f30fcba6b9394f9a84809b293008677e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8449fe4-4ccf-4ace-aa37-69b9213b48d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8449fe4-4ccf-4ace-aa37-69b9213b48d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419af6f9-2ee7-455a-aae4-7d4ce17452be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419af6f9-2ee7-455a-aae4-7d4ce17452be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1fd5cd-e1a4-48f1-ac7b-481025bb9476', 'volume_name': 'volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74b4717-a6d2-419d-bd49-b948297e4c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74b4717-a6d2-419d-bd49-b948297e4c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740ca5fd-20e6-4b15-9ff2-d966fba61ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:28 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Volume fa1fd5cd-e1a4-48f1-ac7b-481025bb9476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476', 'volume_size': 1}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "cinder-8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Acquiring lock "cinder-quobyte-0efba309-6b53-4351-b5e8-ccfeb067cfac" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "cinder-quobyte-0efba309-6b53-4351-b5e8-ccfeb067cfac" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Acquiring lock "cinder-quobyte-8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "cinder-quobyte-8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Deleting offline snapshot 8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb of volume 0efba309-6b53-4351-b5e8-ccfeb067cfac {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] snapshot_file for this snap is: volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4a27d1-9f33-4de1-a209-762d86b91631]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:29 devstack sudo[88187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb
Apr 13 20:32:29 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (ccea5229-7f62-4ea2-aab5-e92633702388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9aebb1c-f995-4c9b-bc3b-b02b1fd2f8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9aebb1c-f995-4c9b-bc3b-b02b1fd2f8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-395190406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed0415a-4a66-48ac-8fec-437f8317f1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:29Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a7647c-a31c-43fb-800d-bacbede573ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a7647c-a31c-43fb-800d-bacbede573ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c205b4b-78d8-40f3-8ff3-c5e809f1120d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c205b4b-78d8-40f3-8ff3-c5e809f1120d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed0415a-4a66-48ac-8fec-437f8317f1e0', 'volume_name': 'volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aeba599-4d03-4e45-8f03-beca14c522c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aeba599-4d03-4e45-8f03-beca14c522c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd54c41-8c75-4363-a960-4f0858400776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:29 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Volume 0ed0415a-4a66-48ac-8fec-437f8317f1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0', 'volume_size': 1}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:29 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c 1073741824" returned: 0 in 0.658s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:29 devstack sudo[88193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c
Apr 13 20:32:29 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Acquiring lock "cinder-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Lock "cinder-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Acquiring lock "cinder-quobyte-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Lock "cinder-quobyte-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d698e4-e943-4c1c-accb-715b70c8e655]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:29 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb" returned: 0 in 0.568s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0efba309-6b53-4351-b5e8-ccfeb067cfac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2b7bf9-a138-42ae-85e8-1cc4ae159dc6]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:29 devstack sudo[88198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a
Apr 13 20:32:29 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:29 devstack sudo[88199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac
Apr 13 20:32:29 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:29 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c" returned: 0 in 0.492s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.406s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1233672856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8811e0-d6d0-44eb-961f-8d27a4ef76b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ebbcd8d5f64c2d90dde19be2bf00aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:28Z,use_quota=True,user_id='f30fcba6b9394f9a84809b293008677e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Creating volume 4c8811e0-d6d0-44eb-961f-8d27a4ef76b6 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:29 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bad796c-6c21-49dc-be01-bafe772afbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df975855-bb2f-45ba-bb73-e664b4858e1c', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:29 devstack sudo[88203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6 1073741824
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f48c16-e4ab-4e67-8cbf-44c6abb11611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:29 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:29 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Volume volume-df975855-bb2f-45ba-bb73-e664b4858e1c (df975855-bb2f-45ba-bb73-e664b4858e1c): created successfully
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f48c16-e4ab-4e67-8cbf-44c6abb11611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Flow 'volume_create_manager' (3efebc7f-2d11-47ca-afd6-640f649ec9e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:29 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-17f40622-6dbe-4e95-b305-1ac7bb1d7908 tempest-CreateVolumesFromImageTest-504036352 None] Created volume successfully.
Apr 13 20:32:30 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" returned: 0 in 0.534s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:30 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac" returned: 0 in 0.486s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:30 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb
Apr 13 20:32:30 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:30 devstack sudo[88210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a
Apr 13 20:32:30 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:30 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6 1073741824" returned: 0 in 0.525s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:30 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6
Apr 13 20:32:30 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:30 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb" returned: 0 in 0.468s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:30 devstack sudo[88225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb
Apr 13 20:32:30 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:30 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" returned: 1 in 0.513s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:30 devstack sudo[88227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a
Apr 13 20:32:30 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:30 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6" returned: 0 in 0.428s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.172s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-710215279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6af77a-3d13-49cf-9db3-9b29eea13026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ebbcd8d5f64c2d90dde19be2bf00aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:28Z,use_quota=True,user_id='f30fcba6b9394f9a84809b293008677e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Creating volume 3b6af77a-3d13-49cf-9db3-9b29eea13026 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:30 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b046b859-09cc-4628-9285-3157b0fd840a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fe2801-0f6a-4d4b-a140-5241fcca951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:30 devstack sudo[88230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026 1073741824
Apr 13 20:32:30 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:30 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Volume volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6 (4c8811e0-d6d0-44eb-961f-8d27a4ef76b6): created successfully
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fe2801-0f6a-4d4b-a140-5241fcca951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Flow 'volume_create_manager' (6f4b6744-e5cc-4c00-8d09-74558e8f0910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:30 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f926e233-345f-44e7-acc3-031e183dd13d tempest-CreateVolumesFromImageTest-504036352 None] Created volume successfully.
Apr 13 20:32:31 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac.8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb" returned: 0 in 0.443s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:31 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" returned: 0 in 0.440s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "cinder-quobyte-8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb" released by "_delete_snapshot" :: held 2.036s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Lock "cinder-quobyte-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a" released by "delete_volume" :: held 1.528s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "cinder-quobyte-0efba309-6b53-4351-b5e8-ccfeb067cfac" released by "delete_snapshot" :: held 2.057s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Created reservations ['d372e4c2-e4ec-47d7-bfe0-44b711d845d5', 'dcf0db21-ed98-4a13-90df-6e98e5dd77a5', '7a46edbb-528c-4f7f-bfd5-12d720474742', '86fd837e-f232-48f1-aea3-dfeef9cffd98'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Delete snapshot completed successfully.
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Created reservations ['a48481a5-2297-4633-b279-1efd4dba50b4', '19c741d3-839b-49f1-b627-4c4860bd8d03', '615d0603-4064-4126-bae1-cbbb17e2ba81', '150ed73e-a2dd-4160-962e-77376eb5f64a'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a1d8ac1f-ad16-4764-b0d6-58c96f37fa51 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "cinder-8102ac7e-5f9c-4a0f-8b3e-d05a147d79eb-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:31 devstack sudo[88237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:31 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:31 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026 1073741824" returned: 0 in 0.534s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:31 devstack sudo[88239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026
Apr 13 20:32:31 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:31 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.422s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Deleted volume successfully.
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d799f6a4-646a-4433-853c-602e5e705d7d tempest-VolumesExtendTest-1341728462 None] Lock "cinder-4ae5a11f-c3e0-4586-bb0c-71532b4eb73a-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:31 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026" returned: 0 in 0.446s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.988s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1928018403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0a0a8c-47b3-465b-af3f-8a0bb6a31013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ebbcd8d5f64c2d90dde19be2bf00aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:29Z,use_quota=True,user_id='f30fcba6b9394f9a84809b293008677e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Creating volume 8d0a0a8c-47b3-465b-af3f-8a0bb6a31013 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:31 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afeabee7-2d53-4855-8412-daa93fe5cf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6af77a-3d13-49cf-9db3-9b29eea13026', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99b283f-cdd5-4bc8-a0e3-dab62b235947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:31 devstack sudo[88243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013 1073741824
Apr 13 20:32:31 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:31 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Volume volume-3b6af77a-3d13-49cf-9db3-9b29eea13026 (3b6af77a-3d13-49cf-9db3-9b29eea13026): created successfully
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99b283f-cdd5-4bc8-a0e3-dab62b235947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Flow 'volume_create_manager' (38d5f266-c26c-4d60-9ecb-da15bdf36556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c3d84ad5-63bb-4d02-8798-183b72e1896b tempest-CreateVolumesFromImageTest-504036352 None] Created volume successfully.
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Flow 'volume_create_manager' (12a82410-ce53-44f5-92e4-3817f2030fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6c191a-2e7f-4ada-9d0e-e9236399b24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6c191a-2e7f-4ada-9d0e-e9236399b24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1250777182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ec736f-7338-4336-963e-57d526043a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3539f3fdca15419fb6b68c3123dfa472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:32Z,use_quota=True,user_id='ab948b8c7f3943e6aa1b24a171b6657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c718ad59-3d0c-4e21-9de1-0e22526f0ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c718ad59-3d0c-4e21-9de1-0e22526f0ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b13b74d-ac41-453a-b17c-a9708a84d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b13b74d-ac41-453a-b17c-a9708a84d470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ec736f-7338-4336-963e-57d526043a7e', 'volume_name': 'volume-66ec736f-7338-4336-963e-57d526043a7e', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdee0c3-4a51-42d8-a0f7-b7a1179e37f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdee0c3-4a51-42d8-a0f7-b7a1179e37f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15df0bd-0402-457b-9a48-8ba332b2a5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:31 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Volume 66ec736f-7338-4336-963e-57d526043a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ec736f-7338-4336-963e-57d526043a7e', 'volume_size': 1}
Apr 13 20:32:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Acquiring lock "cinder-0efba309-6b53-4351-b5e8-ccfeb067cfac-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "cinder-0efba309-6b53-4351-b5e8-ccfeb067cfac-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Acquiring lock "cinder-quobyte-0efba309-6b53-4351-b5e8-ccfeb067cfac" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "cinder-quobyte-0efba309-6b53-4351-b5e8-ccfeb067cfac" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[043a484e-2083-494a-89e1-00922618f7d3]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:32 devstack sudo[88248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac
Apr 13 20:32:32 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:32 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013 1073741824" returned: 0 in 0.539s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:32 devstack sudo[88250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013
Apr 13 20:32:32 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:32 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac" returned: 0 in 0.499s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:32 devstack sudo[88256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac
Apr 13 20:32:32 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:32 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013" returned: 0 in 0.411s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.730s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780942835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1fd5cd-e1a4-48f1-ac7b-481025bb9476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ebbcd8d5f64c2d90dde19be2bf00aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:29Z,use_quota=True,user_id='f30fcba6b9394f9a84809b293008677e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Creating volume fa1fd5cd-e1a4-48f1-ac7b-481025bb9476 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:32 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8332e4f-baf3-41ea-8b89-a8699c8883db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:32 devstack sudo[88258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476 1073741824
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4556859b-534c-4f0b-b244-1fc642a76745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:32 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:32 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Volume volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013 (8d0a0a8c-47b3-465b-af3f-8a0bb6a31013): created successfully
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4556859b-534c-4f0b-b244-1fc642a76745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Flow 'volume_create_manager' (85e5aac5-224b-4d49-a41e-e562f41f14ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:32 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c35c0936-52ac-45de-84ca-2205f94a7d83 tempest-CreateVolumesFromImageTest-504036352 None] Created volume successfully.
Apr 13 20:32:33 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0efba309-6b53-4351-b5e8-ccfeb067cfac" returned: 0 in 0.429s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "cinder-quobyte-0efba309-6b53-4351-b5e8-ccfeb067cfac" released by "delete_volume" :: held 0.957s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Created reservations ['fa41a541-7c77-4214-b303-f6bf88ee85a4', '3e7c7f1e-5365-4d30-a91d-2328db672c41', '0bf75e3d-dd82-4fc5-93e9-134abf815613', '2cd351ab-b93f-4e0b-ac55-924df18cbb74'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:33 devstack sudo[88264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:33 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:33 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476 1073741824" returned: 0 in 0.526s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:33 devstack sudo[88266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476
Apr 13 20:32:33 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:33 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.471s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:33 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Deleted volume successfully.
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-01506045-5d74-419b-8abf-d1e43b1ade99 tempest-SnapshotMetadataTestJSON-1829829520 None] Lock "cinder-0efba309-6b53-4351-b5e8-ccfeb067cfac-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:33 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476" returned: 0 in 0.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.557s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-395190406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed0415a-4a66-48ac-8fec-437f8317f1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:29Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Creating volume 0ed0415a-4a66-48ac-8fec-437f8317f1e0 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:33 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740ca5fd-20e6-4b15-9ff2-d966fba61ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:33 devstack sudo[88270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0 1073741824
Apr 13 20:32:33 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70bb788-1bc6-4a0d-b787-a3e1d7517cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:33 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Volume volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476 (fa1fd5cd-e1a4-48f1-ac7b-481025bb9476): created successfully
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70bb788-1bc6-4a0d-b787-a3e1d7517cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Flow 'volume_create_manager' (b9c02c5b-db65-4cb5-8dfd-3d434ac604db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:33 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-22d59cca-8c8f-4bee-bdcd-8d62d50c8b76 tempest-CreateVolumesFromImageTest-504036352 None] Created volume successfully.
Apr 13 20:32:34 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0 1073741824" returned: 0 in 0.586s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "cinder-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:34 devstack sudo[88275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0
Apr 13 20:32:34 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "cinder-quobyte-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-quobyte-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0c39f-532f-4f6f-9309-54f790991bba]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:34 devstack sudo[88277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476
Apr 13 20:32:34 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:34 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0" returned: 0 in 0.481s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.934s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1250777182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ec736f-7338-4336-963e-57d526043a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3539f3fdca15419fb6b68c3123dfa472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:32Z,use_quota=True,user_id='ab948b8c7f3943e6aa1b24a171b6657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Creating volume 66ec736f-7338-4336-963e-57d526043a7e {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:34 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd54c41-8c75-4363-a960-4f0858400776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797fc8f9-2d90-4960-b69a-296a595e1697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:34 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e 1073741824
Apr 13 20:32:34 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:34 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Volume volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0 (0ed0415a-4a66-48ac-8fec-437f8317f1e0): created successfully
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797fc8f9-2d90-4960-b69a-296a595e1697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (ccea5229-7f62-4ea2-aab5-e92633702388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:34 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3247c5ff-c3b4-4511-8a44-9eb0c5e8ec21 tempest-VolumesActionsTest-358394727 None] Created volume successfully.
Apr 13 20:32:35 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476" returned: 0 in 0.562s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:35 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476
Apr 13 20:32:35 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:35 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e 1073741824" returned: 0 in 0.622s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:35 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476" returned: 0 in 0.486s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-quobyte-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476" released by "delete_volume" :: held 1.075s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:35 devstack sudo[88291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e
Apr 13 20:32:35 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Created reservations ['8797c7da-054c-46d8-b9e1-378443078eea', '13132425-5d75-4b1b-9777-c825b9cc200d', '7f9f78c2-c13d-4b20-a200-741d6fe8e8e3', '4ab29386-d8b8-424f-a25c-2d828558ef27'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Acquiring lock "cinder-0ed0415a-4a66-48ac-8fec-437f8317f1e0-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:35 devstack sudo[88293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:35 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Lock "cinder-0ed0415a-4a66-48ac-8fec-437f8317f1e0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Acquiring lock "cinder-quobyte-0ed0415a-4a66-48ac-8fec-437f8317f1e0" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Lock "cinder-quobyte-0ed0415a-4a66-48ac-8fec-437f8317f1e0" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab58356f-412e-4b17-a41e-b115bbcee5c7]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:35 devstack sudo[88295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0
Apr 13 20:32:35 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:36 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e" returned: 0 in 0.500s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15df0bd-0402-457b-9a48-8ba332b2a5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ec736f-7338-4336-963e-57d526043a7e', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed4bb1e-8f31-42a5-b07d-e4c6eec7bbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:36 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Volume volume-66ec736f-7338-4336-963e-57d526043a7e (66ec736f-7338-4336-963e-57d526043a7e): created successfully
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed4bb1e-8f31-42a5-b07d-e4c6eec7bbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Flow 'volume_create_manager' (12a82410-ce53-44f5-92e4-3817f2030fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:36 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d4c494db-6c0d-4fe8-9621-128c1772f87c tempest-VolumesExtendTest-1341728462 None] Created volume successfully.
Apr 13 20:32:36 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.481s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:36 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Deleted volume successfully.
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e71e20a6-90fe-4aac-9c79-97aeb204e91d tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-fa1fd5cd-e1a4-48f1-ac7b-481025bb9476-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:36 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0" returned: 0 in 0.571s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:36 devstack sudo[88302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0
Apr 13 20:32:36 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "cinder-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "cinder-quobyte-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-quobyte-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd75aa0-d425-43bb-8281-3ad40afc1285]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:36 devstack sudo[88304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013
Apr 13 20:32:36 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:36 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0ed0415a-4a66-48ac-8fec-437f8317f1e0" returned: 0 in 0.510s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Lock "cinder-quobyte-0ed0415a-4a66-48ac-8fec-437f8317f1e0" released by "delete_volume" :: held 1.104s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Created reservations ['ddd357e9-11fb-4402-897d-2af80b3b318d', '557dcade-d5d9-4cd3-8b80-6499f2d5cc6a', '1a06f67d-8b4a-4164-9c56-e1c15108dfb5', '41e2f386-2e1a-45a9-a1a0-318e39413d2c'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:36 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:36 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Flow 'volume_create_manager' (689d73f9-14b1-44dd-a91b-45e3b5eff45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f07d5c0-6bd9-4a05-ba78-35ea008b85ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f07d5c0-6bd9-4a05-ba78-35ea008b85ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-736647849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cc20c8-7e1f-4553-94be-e214d4492578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967db1652bbf4d6588bd5d3339a67c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:37Z,use_quota=True,user_id='e84004e7dcde441bb6d3f6a6fd46f91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7333262-8154-4401-8dae-91e3183cd28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7333262-8154-4401-8dae-91e3183cd28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25019e9a-3674-4a1d-8cb1-c376b11bf336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25019e9a-3674-4a1d-8cb1-c376b11bf336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9cc20c8-7e1f-4553-94be-e214d4492578', 'volume_name': 'volume-b9cc20c8-7e1f-4553-94be-e214d4492578', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451014f9-e306-45ad-bdc8-21191c9d8214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451014f9-e306-45ad-bdc8-21191c9d8214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2e20f1-3aa7-419c-a74f-6d36b4369474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:37 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Volume b9cc20c8-7e1f-4553-94be-e214d4492578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9cc20c8-7e1f-4553-94be-e214d4492578', 'volume_size': 1}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-736647849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cc20c8-7e1f-4553-94be-e214d4492578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967db1652bbf4d6588bd5d3339a67c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:37Z,use_quota=True,user_id='e84004e7dcde441bb6d3f6a6fd46f91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Creating volume b9cc20c8-7e1f-4553-94be-e214d4492578 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:37 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:37 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013" returned: 0 in 0.523s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:37 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578 1073741824
Apr 13 20:32:37 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:37 devstack sudo[88313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013
Apr 13 20:32:37 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:37 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.495s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:37 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Deleted volume successfully.
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3b03c45a-76aa-4827-92c3-bec4190c57ff tempest-VolumesActionsTest-924411195 None] Lock "cinder-0ed0415a-4a66-48ac-8fec-437f8317f1e0-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:37 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013" returned: 0 in 0.497s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-quobyte-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013" released by "delete_volume" :: held 1.041s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:37 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578 1073741824" returned: 0 in 0.543s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Created reservations ['b79ff8bd-e8c2-4c4e-b657-8aaaa6b03061', '823eb7bf-8e17-404a-8c44-2a0ac193b9d3', '1c68b34e-ac50-4eb9-b243-a25577f2ec13', 'b79257ca-9db9-4158-b85e-48a8228ae4aa'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:37 devstack sudo[88321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578
Apr 13 20:32:37 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:37 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:37 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (d8e66d81-277f-49d2-9940-c0047243ee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cfc806-b06f-417f-b6ff-67ef183645c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cfc806-b06f-417f-b6ff-67ef183645c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2104628649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:38Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142cff73-cfc6-4d0f-bf57-0c345590612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142cff73-cfc6-4d0f-bf57-0c345590612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0799935-fd6a-42e1-9aa2-8b5a4ee5d179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0799935-fd6a-42e1-9aa2-8b5a4ee5d179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7', 'volume_name': 'volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b61887-9887-4126-9dea-127182bd976c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b61887-9887-4126-9dea-127182bd976c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b8a6b3-ebd5-4124-9253-85255492ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:38 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Volume 35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7', 'volume_size': 1}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:38 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578" returned: 0 in 0.463s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.888s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2e20f1-3aa7-419c-a74f-6d36b4369474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9cc20c8-7e1f-4553-94be-e214d4492578', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d83583f-48cf-448a-aac2-6bfd4f73cef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] Creating offline snapshot 208b325b-bf4b-4aaf-b5f8-7a815f469ce8 of volume 66ec736f-7338-4336-963e-57d526043a7e {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:32:38 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Volume volume-b9cc20c8-7e1f-4553-94be-e214d4492578 (b9cc20c8-7e1f-4553-94be-e214d4492578): created successfully
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d83583f-48cf-448a-aac2-6bfd4f73cef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Flow 'volume_create_manager' (689d73f9-14b1-44dd-a91b-45e3b5eff45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[db30ddcd-0195-4a73-93c5-a5a6aa1e3008]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:38 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-78682d5d-d925-4830-ab48-a83beacfa531 tempest-AbsoluteLimitsTests-1054830948 None] Created volume successfully.
Apr 13 20:32:38 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.494s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:38 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Deleted volume successfully.
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7e41e7d3-1730-4ff9-a677-3595bbe1054f tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-8d0a0a8c-47b3-465b-af3f-8a0bb6a31013-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:38 devstack sudo[88327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e
Apr 13 20:32:38 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:38 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e" returned: 0 in 0.482s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:38 devstack sudo[88332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 1G
Apr 13 20:32:38 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "cinder-3b6af77a-3d13-49cf-9db3-9b29eea13026-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-3b6af77a-3d13-49cf-9db3-9b29eea13026-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "cinder-quobyte-3b6af77a-3d13-49cf-9db3-9b29eea13026" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-quobyte-3b6af77a-3d13-49cf-9db3-9b29eea13026" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[afff5145-6c25-4892-b80b-a67950d3e11b]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:38 devstack sudo[88334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026
Apr 13 20:32:38 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:39 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 1G" returned: 0 in 0.538s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ec736f-7338-4336-963e-57d526043a7e -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:39 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ec736f-7338-4336-963e-57d526043a7e -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8
Apr 13 20:32:39 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Acquiring lock "cinder-b9cc20c8-7e1f-4553-94be-e214d4492578-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Lock "cinder-b9cc20c8-7e1f-4553-94be-e214d4492578-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:39 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026" returned: 0 in 0.524s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:39 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026
Apr 13 20:32:39 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Acquiring lock "cinder-quobyte-b9cc20c8-7e1f-4553-94be-e214d4492578" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Lock "cinder-quobyte-b9cc20c8-7e1f-4553-94be-e214d4492578" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3865f26-bef7-4765-938e-4f8a07ea69d8]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:39 devstack sudo[88347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578
Apr 13 20:32:39 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:39 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ec736f-7338-4336-963e-57d526043a7e -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8" returned: 0 in 0.473s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:39 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 is being set with open permissions: ugo+rw
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:39 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8
Apr 13 20:32:39 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:39 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b6af77a-3d13-49cf-9db3-9b29eea13026" returned: 0 in 0.416s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-quobyte-3b6af77a-3d13-49cf-9db3-9b29eea13026" released by "delete_volume" :: held 0.970s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Created reservations ['2f3f6b9f-ea04-43fe-b87b-05c5ddebabdd', '4c7ec3f3-ab02-4434-9a89-1d14e1e0b661', 'ad4166a8-42d0-40e6-807c-308f01492e04', 'fb35bd3c-67db-4a76-9c80-9886541f8863'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:39 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:39 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:39 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578" returned: 0 in 0.531s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:40 devstack sudo[88360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578
Apr 13 20:32:40 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:40 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8" returned: 0 in 0.440s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:40 devstack sudo[88363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.info
Apr 13 20:32:40 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:40 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.421s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:40 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b9cc20c8-7e1f-4553-94be-e214d4492578" returned: 0 in 0.410s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:40 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Deleted volume successfully.
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Lock "cinder-quobyte-b9cc20c8-7e1f-4553-94be-e214d4492578" released by "delete_volume" :: held 0.980s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0fc4ba51-261c-44b9-813b-1d5fa54accb3 tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-3b6af77a-3d13-49cf-9db3-9b29eea13026-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Created reservations ['7341dd03-b444-4222-8bcf-805ae49a7dfb', 'c5e1fbd2-af65-4cc9-b29a-0882a55e43ed', 'a17805cf-573b-4140-a1ed-a69065208c4a', '015ccb47-67ba-41f3-9c07-63fb212b92fd'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:40 devstack sudo[88367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:40 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:40 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.info" returned: 0 in 0.426s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:40 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.info is being set with open permissions: ugo+rw
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:40 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.info
Apr 13 20:32:40 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:40 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.397s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:40 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Deleted volume successfully.
Apr 13 20:32:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cc2d7839-f193-4528-a21c-17bf1672da8e tempest-AbsoluteLimitsTests-1054830948 None] Lock "cinder-b9cc20c8-7e1f-4553-94be-e214d4492578-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "cinder-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "cinder-quobyte-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-quobyte-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db3b040-3ce4-4c1d-b856-147028165a7a]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:41 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.info" returned: 0 in 0.432s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.925s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2104628649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:38Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Creating volume 35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:41 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:41 devstack sudo[88374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6
Apr 13 20:32:41 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-abe31cc9-92f2-41da-a3f2-dca8ec2564ee tempest-VolumesExtendTest-1341728462 None] Create snapshot completed successfully
Apr 13 20:32:41 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7 1073741824
Apr 13 20:32:41 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:41 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6" returned: 0 in 0.501s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:41 devstack sudo[88384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6
Apr 13 20:32:41 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-797090b4-dd62-47f3-9d8e-d1bdb6eecb30 tempest-VolumesExtendTest-1341728462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:41 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7 1073741824" returned: 0 in 0.568s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:41 devstack sudo[88386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7
Apr 13 20:32:41 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:42 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6" returned: 0 in 0.459s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-quobyte-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6" released by "delete_volume" :: held 0.990s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Created reservations ['080f2f98-1f14-4c3c-85e2-a5023cd38ec5', '73bc39a3-f65a-4c6e-be68-46681eaa5536', '6e3f4389-8eb8-4b9c-a95a-a0e55b691300', '51aade72-00b7-4cce-9740-895676fe4a48'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:42 devstack sudo[88390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:42 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:42 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7" returned: 0 in 0.491s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-797090b4-dd62-47f3-9d8e-d1bdb6eecb30 tempest-VolumesExtendTest-1341728462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.586s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b8a6b3-ebd5-4124-9253-85255492ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04ac788-1dba-41f6-b83c-ee5ada1d07b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5edf7c2-9768-4055-a171-9ad41a12e486]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-797090b4-dd62-47f3-9d8e-d1bdb6eecb30 tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:42 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Volume volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7 (35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7): created successfully
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04ac788-1dba-41f6-b83c-ee5ada1d07b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (d8e66d81-277f-49d2-9940-c0047243ee07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:42 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8fab60d4-e368-4e96-badb-525cf2c1de7d tempest-VolumesActionsTest-358394727 None] Created volume successfully.
Apr 13 20:32:42 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e
Apr 13 20:32:42 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Acquiring lock "cinder-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Lock "cinder-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Acquiring lock "cinder-quobyte-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Lock "cinder-quobyte-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:42 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.441s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db0ffdf-d79d-4fe4-b9b7-c6733aae1f4c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:42 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Deleted volume successfully.
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-db0694ac-c498-4edd-875b-67d11f0ff0cc tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-4c8811e0-d6d0-44eb-961f-8d27a4ef76b6-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:42 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7
Apr 13 20:32:42 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:42 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-797090b4-dd62-47f3-9d8e-d1bdb6eecb30 tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e" returned: 0 in 0.622s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-797090b4-dd62-47f3-9d8e-d1bdb6eecb30 tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 2G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-797090b4-dd62-47f3-9d8e-d1bdb6eecb30 tempest-VolumesExtendTest-1341728462 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 2G" returned: 0 in 0.071s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-797090b4-dd62-47f3-9d8e-d1bdb6eecb30 tempest-VolumesExtendTest-1341728462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.723s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:42 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-797090b4-dd62-47f3-9d8e-d1bdb6eecb30 tempest-VolumesExtendTest-1341728462 None] Extend volume completed successfully.
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "cinder-df975855-bb2f-45ba-bb73-e664b4858e1c-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-df975855-bb2f-45ba-bb73-e664b4858e1c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:43 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7" returned: 0 in 0.610s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:43 devstack sudo[88408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7
Apr 13 20:32:43 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "cinder-quobyte-df975855-bb2f-45ba-bb73-e664b4858e1c" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-quobyte-df975855-bb2f-45ba-bb73-e664b4858e1c" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea12441-532c-410d-a539-8837e5d0e2af]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:43 devstack sudo[88410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c
Apr 13 20:32:43 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:43 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7" returned: 0 in 0.522s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Lock "cinder-quobyte-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7" released by "delete_volume" :: held 1.169s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Created reservations ['3cac9d1a-69f7-4700-94d5-390c5eb23256', 'e1ef076b-78c7-4e0d-8363-2278e365392d', 'adfbcbc8-5c89-42e1-bca5-814a028e6869', 'fe57dea9-439b-4cf1-80f2-4a4ea6b27f7e'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Acquiring lock "cinder-208b325b-bf4b-4aaf-b5f8-7a815f469ce8-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:43 devstack sudo[88418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:43 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:43 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c" returned: 0 in 0.605s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Lock "cinder-208b325b-bf4b-4aaf-b5f8-7a815f469ce8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Acquiring lock "cinder-quobyte-66ec736f-7338-4336-963e-57d526043a7e" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Lock "cinder-quobyte-66ec736f-7338-4336-963e-57d526043a7e" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Acquiring lock "cinder-quobyte-208b325b-bf4b-4aaf-b5f8-7a815f469ce8" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:43 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c
Apr 13 20:32:43 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Lock "cinder-quobyte-208b325b-bf4b-4aaf-b5f8-7a815f469ce8" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Deleting offline snapshot 208b325b-bf4b-4aaf-b5f8-7a815f469ce8 of volume 66ec736f-7338-4336-963e-57d526043a7e {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] snapshot_file for this snap is: volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c125c1d-94f9-4841-9704-db3addc0e9ab]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:44 devstack sudo[88422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8
Apr 13 20:32:44 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Flow 'volume_create_manager' (00ac06c9-b4ed-4f08-9cc2-4a82b34a206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561fc1bc-58fb-461d-828c-3c4c5fb13d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561fc1bc-58fb-461d-828c-3c4c5fb13d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1200310138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b25514-0421-4464-8acf-6ffa979af92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bec8ea864664de19b5db96cdd1d5658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:44Z,use_quota=True,user_id='b48cb77efb4e409985f1cc08d3482b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c1363c-a25f-449e-bfb4-f693229b171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c1363c-a25f-449e-bfb4-f693229b171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c472159-d8ac-4af4-bc97-aa4fdefab375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c472159-d8ac-4af4-bc97-aa4fdefab375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8b25514-0421-4464-8acf-6ffa979af92c', 'volume_name': 'volume-d8b25514-0421-4464-8acf-6ffa979af92c', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe811393-a580-415b-a334-705d45ecf553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe811393-a580-415b-a334-705d45ecf553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc93e04-935d-4b66-8eaa-f21bb002f1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:44 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Volume d8b25514-0421-4464-8acf-6ffa979af92c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8b25514-0421-4464-8acf-6ffa979af92c', 'volume_size': 1}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1200310138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b25514-0421-4464-8acf-6ffa979af92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bec8ea864664de19b5db96cdd1d5658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:44Z,use_quota=True,user_id='b48cb77efb4e409985f1cc08d3482b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Creating volume d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:44 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:44 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.451s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:44 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Deleted volume successfully.
Apr 13 20:32:44 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c 1073741824
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6efdc373-a1a4-45dc-9fac-d50150d38cb1 tempest-VolumesActionsTest-924411195 None] Lock "cinder-35bce2c9-0ac3-4656-8d5b-65e7ab61c4b7-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:44 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:44 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-df975855-bb2f-45ba-bb73-e664b4858e1c" returned: 0 in 0.533s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-quobyte-df975855-bb2f-45ba-bb73-e664b4858e1c" released by "delete_volume" :: held 1.167s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:44 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Created reservations ['3d778949-5b4b-4969-98f9-3b961a68d6ad', '9d53d4c3-4d9f-4b50-9363-0ccdcb473d04', 'ec9a2925-170a-4c63-bf4a-5781f5927607', '5fced275-6dee-4108-8dc3-cd941dea8e30'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8" returned: 0 in 0.536s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66ec736f-7338-4336-963e-57d526043a7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[305d5959-9b3b-4767-93c5-cd4a28868397]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:44 devstack sudo[88432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:44 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:44 devstack sudo[88431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e
Apr 13 20:32:44 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:44 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c 1073741824" returned: 0 in 0.514s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:44 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c
Apr 13 20:32:44 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:45 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.482s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:45 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Deleted volume successfully.
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:45 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (3429c742-e92e-42b6-82fb-fe136da29142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79939a59-c6cf-4b02-b247-f2f6068f2d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e" returned: 0 in 0.561s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27e5e693-66a6-4c6e-8220-fbf0b7de9f6c tempest-CreateVolumesFromImageTest-504036352 None] Lock "cinder-df975855-bb2f-45ba-bb73-e664b4858e1c-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79939a59-c6cf-4b02-b247-f2f6068f2d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-964918037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5d322d-df6a-4e6e-b97e-13dc5040ce6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:45Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:45 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8
Apr 13 20:32:45 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9f31dc-6d42-46e3-b281-c0e6a1c2ae14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9f31dc-6d42-46e3-b281-c0e6a1c2ae14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1b31fa-779a-4ed4-8191-6d6a4355718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1b31fa-779a-4ed4-8191-6d6a4355718a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5d322d-df6a-4e6e-b97e-13dc5040ce6a', 'volume_name': 'volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45e8e4e-9ee4-48fe-941e-44714b67ba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45e8e4e-9ee4-48fe-941e-44714b67ba44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5baf00-84c1-4599-838c-52d1617fdbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:45 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Volume 3b5d322d-df6a-4e6e-b97e-13dc5040ce6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a', 'volume_size': 1}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:45 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c" returned: 0 in 0.506s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-964918037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5d322d-df6a-4e6e-b97e-13dc5040ce6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:45Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Creating volume 3b5d322d-df6a-4e6e-b97e-13dc5040ce6a {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:45 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc93e04-935d-4b66-8eaa-f21bb002f1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8b25514-0421-4464-8acf-6ffa979af92c', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:45 devstack sudo[88447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a 1073741824
Apr 13 20:32:45 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114d44bc-e3b5-4006-9cb1-eb28b779d3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:45 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Volume volume-d8b25514-0421-4464-8acf-6ffa979af92c (d8b25514-0421-4464-8acf-6ffa979af92c): created successfully
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114d44bc-e3b5-4006-9cb1-eb28b779d3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Flow 'volume_create_manager' (00ac06c9-b4ed-4f08-9cc2-4a82b34a206a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:45 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d509a43f-c834-4ab4-ab70-56d3d5f87e34 tempest-VolumesDeleteCascade-1009375877 None] Created volume successfully.
Apr 13 20:32:45 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8" returned: 0 in 0.487s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:45 devstack sudo[88452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8
Apr 13 20:32:45 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:45 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a 1073741824" returned: 0 in 0.571s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:45 devstack sudo[88458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a
Apr 13 20:32:45 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:45 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e.208b325b-bf4b-4aaf-b5f8-7a815f469ce8" returned: 0 in 0.453s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Lock "cinder-quobyte-208b325b-bf4b-4aaf-b5f8-7a815f469ce8" released by "_delete_snapshot" :: held 2.104s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Lock "cinder-quobyte-66ec736f-7338-4336-963e-57d526043a7e" released by "delete_snapshot" :: held 2.119s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Created reservations ['524b6029-aeea-4898-8640-ac0f0c9d70a6', 'c36ae8b4-add9-44ad-8004-4f8d2490dd86', '352b8257-944f-4f5f-8722-10a7692522ad', '3fbac43f-0497-4dba-a824-c22cf23c4c1f'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:46 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Delete snapshot completed successfully.
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d6857446-ed45-4720-9b27-014db8106876 tempest-VolumesExtendTest-1341728462 None] Lock "cinder-208b325b-bf4b-4aaf-b5f8-7a815f469ce8-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:46 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a" returned: 0 in 0.511s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.033s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] Creating offline snapshot 79daa7f7-62f7-4538-96bb-8811b7bbc1a5 of volume d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5baf00-84c1-4599-838c-52d1617fdbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29de8fd9-62fe-4db4-aed9-5b7c9b7be0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda78d12-0147-4250-87f4-b61a6bc2ec03]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:46 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Volume volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a (3b5d322d-df6a-4e6e-b97e-13dc5040ce6a): created successfully
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29de8fd9-62fe-4db4-aed9-5b7c9b7be0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (3429c742-e92e-42b6-82fb-fe136da29142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:46 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-49cc5cf0-7967-4f50-9692-8bd2aae22f1c tempest-VolumesActionsTest-358394727 None] Created volume successfully.
Apr 13 20:32:46 devstack sudo[88461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c
Apr 13 20:32:46 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:47 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c" returned: 0 in 0.578s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:47 devstack sudo[88466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 1G
Apr 13 20:32:47 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Acquiring lock "cinder-66ec736f-7338-4336-963e-57d526043a7e-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Lock "cinder-66ec736f-7338-4336-963e-57d526043a7e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Acquiring lock "cinder-quobyte-66ec736f-7338-4336-963e-57d526043a7e" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Lock "cinder-quobyte-66ec736f-7338-4336-963e-57d526043a7e" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8b1b4e-ab34-4b04-9667-b0a8295bd624]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Flow 'volume_create_manager' (093be139-609c-48fa-9e8e-52a8e8f33116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7e3220-4341-4710-898f-4486321dee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7e3220-4341-4710-898f-4486321dee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb883005-68b2-45f2-8c9c-a511b32a2e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934450f46917433eb4b6a07e36449234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:47Z,use_quota=True,user_id='1ea3cde94ce948858d17f13e4c522769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63694533-7020-45d9-bf48-508a2ee84ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63694533-7020-45d9-bf48-508a2ee84ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21a14f6-e6f2-4980-b6fe-ca2f39cb955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:47 devstack sudo[88468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e
Apr 13 20:32:47 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21a14f6-e6f2-4980-b6fe-ca2f39cb955a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb883005-68b2-45f2-8c9c-a511b32a2e02', 'volume_name': 'volume-eb883005-68b2-45f2-8c9c-a511b32a2e02', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31abc01a-0398-4e0f-be17-f1e22426b126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31abc01a-0398-4e0f-be17-f1e22426b126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407ffe96-60e6-4046-aadb-2b3c5d207c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:47 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Volume eb883005-68b2-45f2-8c9c-a511b32a2e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb883005-68b2-45f2-8c9c-a511b32a2e02', 'volume_size': 1}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Acquiring lock "cinder-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Lock "cinder-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Acquiring lock "cinder-quobyte-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Lock "cinder-quobyte-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[19897c98-8999-43b3-8085-80eb7ce41008]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:47 devstack sudo[88470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a
Apr 13 20:32:47 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:47 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 1G" returned: 0 in 0.548s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b25514-0421-4464-8acf-6ffa979af92c -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:47 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b25514-0421-4464-8acf-6ffa979af92c -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5
Apr 13 20:32:47 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:47 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e" returned: 0 in 0.527s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:47 devstack sudo[88481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e
Apr 13 20:32:47 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:47 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a" returned: 0 in 0.497s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:47 devstack sudo[88485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a
Apr 13 20:32:47 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:48 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b25514-0421-4464-8acf-6ffa979af92c -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5" returned: 0 in 0.441s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:48 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 is being set with open permissions: ugo+rw
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:48 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5
Apr 13 20:32:48 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:48 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-66ec736f-7338-4336-963e-57d526043a7e" returned: 0 in 0.408s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Lock "cinder-quobyte-66ec736f-7338-4336-963e-57d526043a7e" released by "delete_volume" :: held 0.965s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Created reservations ['4504e149-2536-48f3-a8a0-e34a45183457', 'd353d22c-e1cc-4043-9441-dd50e81dc4b1', '51361146-e0f4-4a03-8eb6-3f880c3f9799', '695b292e-ed93-46bd-9a76-9dc1fe792c0e'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:48 devstack sudo[88494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:48 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:48 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a" returned: 0 in 0.496s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Lock "cinder-quobyte-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a" released by "delete_volume" :: held 1.016s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Created reservations ['fd3a728b-e18e-46e3-86d1-2d0e8cecd0d0', '2b8f2667-bd4c-4619-ae14-2602a5d211f6', '682c83f8-fc92-4d7d-b81d-9d4c77f2b80f', 'ae5cf96d-8abe-4a1a-a588-88ce4d7ad279'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:48 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:48 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:48 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5" returned: 0 in 0.479s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:48 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.info
Apr 13 20:32:48 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:48 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.547s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:48 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Deleted volume successfully.
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4602e66f-3b08-4949-a7e1-2683842724fb tempest-VolumesExtendTest-1341728462 None] Lock "cinder-66ec736f-7338-4336-963e-57d526043a7e-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:48 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.474s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:48 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Deleted volume successfully.
Apr 13 20:32:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-74f1c123-2d4b-4e55-b725-3e52bceb2e33 tempest-VolumesActionsTest-924411195 None] Lock "cinder-3b5d322d-df6a-4e6e-b97e-13dc5040ce6a-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:49 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.info" returned: 0 in 0.479s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:49 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.info is being set with open permissions: ugo+rw
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:49 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.info
Apr 13 20:32:49 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:49 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.info" returned: 0 in 0.471s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.064s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.235s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb883005-68b2-45f2-8c9c-a511b32a2e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934450f46917433eb4b6a07e36449234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:47Z,use_quota=True,user_id='1ea3cde94ce948858d17f13e4c522769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Creating volume eb883005-68b2-45f2-8c9c-a511b32a2e02 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:49 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:49 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02 1073741824
Apr 13 20:32:49 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:49 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-dfbbdd53-f875-44ce-ac85-97a1f0735497 tempest-VolumesDeleteCascade-1009375877 None] Create snapshot completed successfully
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (7d39f085-2d91-4bc6-816a-41a2280d0c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fde050d-be27-4131-896c-25c70abb39ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fde050d-be27-4131-896c-25c70abb39ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2041991357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4452a508-0322-4054-bd26-49d0896b1c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:50Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed938ea2-7df0-4042-b068-80cf84c81f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed938ea2-7df0-4042-b068-80cf84c81f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afac2de5-473e-461b-966f-33de2767fc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afac2de5-473e-461b-966f-33de2767fc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4452a508-0322-4054-bd26-49d0896b1c10', 'volume_name': 'volume-4452a508-0322-4054-bd26-49d0896b1c10', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffebbc0-5ed3-4aa4-9f85-4bd5c22f77b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffebbc0-5ed3-4aa4-9f85-4bd5c22f77b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932272ee-1a52-4da4-aa2a-240ee48c9a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:49 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Volume 4452a508-0322-4054-bd26-49d0896b1c10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4452a508-0322-4054-bd26-49d0896b1c10', 'volume_size': 1}
Apr 13 20:32:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:50 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02 1073741824" returned: 0 in 0.579s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:50 devstack sudo[88513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02
Apr 13 20:32:50 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:50 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02" returned: 0 in 0.494s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2041991357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4452a508-0322-4054-bd26-49d0896b1c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:50Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Creating volume 4452a508-0322-4054-bd26-49d0896b1c10 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:50 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407ffe96-60e6-4046-aadb-2b3c5d207c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb883005-68b2-45f2-8c9c-a511b32a2e02', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f49fda-4a76-4070-aa01-676cf9d24c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:50 devstack sudo[88516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10 1073741824
Apr 13 20:32:50 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:50 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Volume volume-eb883005-68b2-45f2-8c9c-a511b32a2e02 (eb883005-68b2-45f2-8c9c-a511b32a2e02): created successfully
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f49fda-4a76-4070-aa01-676cf9d24c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Flow 'volume_create_manager' (093be139-609c-48fa-9e8e-52a8e8f33116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:50 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-ec29d68f-8f60-4e43-9720-9338c5d6eac9 tempest-CinderUnicodeTest-1287774608 None] Created volume successfully.
Apr 13 20:32:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:51 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10 1073741824" returned: 0 in 0.579s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:51 devstack sudo[88521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10
Apr 13 20:32:51 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Flow 'volume_create_manager' (583785b2-b487-4ba0-b845-8e13136919f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d34a347-8956-4dc7-864a-5f3eaef228bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d34a347-8956-4dc7-864a-5f3eaef228bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1528092861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29bc85a7-8a96-42a0-bfc4-aa107163f261,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fbc8e828b64ad99a49335e7b084076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:51Z,use_quota=True,user_id='e520130e2bc94237aa27dcb0bd6597ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80976061-2558-4447-afbb-75f3daa396ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80976061-2558-4447-afbb-75f3daa396ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6836f73-e1f1-48f3-9a0d-0a503c84a975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6836f73-e1f1-48f3-9a0d-0a503c84a975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29bc85a7-8a96-42a0-bfc4-aa107163f261', 'volume_name': 'volume-29bc85a7-8a96-42a0-bfc4-aa107163f261', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fcee1f9-dd4a-4be3-aa82-f1208ffaa05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fcee1f9-dd4a-4be3-aa82-f1208ffaa05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0571ef3a-eaee-4935-8aa9-0e9543c88682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:51 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Volume 29bc85a7-8a96-42a0-bfc4-aa107163f261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29bc85a7-8a96-42a0-bfc4-aa107163f261', 'volume_size': 1}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Flow 'volume_create_manager' (9fa7c0ce-88ae-45f5-975e-f4ed67dc9415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba159067-4f79-41ac-9286-2d65050e7cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:51 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba159067-4f79-41ac-9286-2d65050e7cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1516596308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c070877-04af-4c4d-a609-9941ceffbf8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934450f46917433eb4b6a07e36449234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:52Z,use_quota=True,user_id='1ea3cde94ce948858d17f13e4c522769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb2e8ed-55b8-4dba-9d27-c5705994f36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb2e8ed-55b8-4dba-9d27-c5705994f36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df9bafc-7014-479b-b623-60d1fc99ce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df9bafc-7014-479b-b623-60d1fc99ce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c070877-04af-4c4d-a609-9941ceffbf8f', 'volume_name': 'volume-2c070877-04af-4c4d-a609-9941ceffbf8f', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867636e2-bdc2-42c3-8604-87e91e1f5e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867636e2-bdc2-42c3-8604-87e91e1f5e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e6fbca-feab-4d90-8c9f-06c8dbdfe3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:51 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Volume 2c070877-04af-4c4d-a609-9941ceffbf8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c070877-04af-4c4d-a609-9941ceffbf8f', 'volume_size': 1}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10" returned: 0 in 0.489s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.983s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932272ee-1a52-4da4-aa2a-240ee48c9a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4452a508-0322-4054-bd26-49d0896b1c10', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5abc3d-abc0-490d-bffa-eeecbf74f967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] Creating offline snapshot d877c9ef-e72e-403d-a22b-8f16ca7207a1 of volume d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:32:51 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Volume volume-4452a508-0322-4054-bd26-49d0896b1c10 (4452a508-0322-4054-bd26-49d0896b1c10): created successfully
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5abc3d-abc0-490d-bffa-eeecbf74f967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (7d39f085-2d91-4bc6-816a-41a2280d0c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ca0a27-3ef4-458c-a861-dde986cd7c94]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:51 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d25f7add-7eed-4f1f-ad99-5fbb84b7a012 tempest-VolumesActionsTest-358394727 None] Created volume successfully.
Apr 13 20:32:51 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5
Apr 13 20:32:51 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Acquiring lock "cinder-4452a508-0322-4054-bd26-49d0896b1c10-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Lock "cinder-4452a508-0322-4054-bd26-49d0896b1c10-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Acquiring lock "cinder-quobyte-4452a508-0322-4054-bd26-49d0896b1c10" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Lock "cinder-quobyte-4452a508-0322-4054-bd26-49d0896b1c10" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1c41d9-fa42-4a00-b8cb-5f8a245a18a0]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:52 devstack sudo[88526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10
Apr 13 20:32:52 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:52 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5" returned: 0 in 0.527s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8b25514-0421-4464-8acf-6ffa979af92c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:52 devstack sudo[88531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 1G
Apr 13 20:32:52 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:52 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10" returned: 0 in 0.482s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:52 devstack sudo[88536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10
Apr 13 20:32:52 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:52 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 1G" returned: 0 in 0.499s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:52 devstack sudo[88541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1
Apr 13 20:32:52 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:52 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4452a508-0322-4054-bd26-49d0896b1c10" returned: 0 in 0.444s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Lock "cinder-quobyte-4452a508-0322-4054-bd26-49d0896b1c10" released by "delete_volume" :: held 0.949s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Created reservations ['3c553eb2-fed1-45df-995c-f4800df7db6e', '50d735ed-6448-4b00-8049-c6c3095b10cf', '0610a7e3-b940-4931-8772-5c80d7ae7b0d', '00367ea5-4f2c-42b7-85d5-24cb96ea2685'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:53 devstack sudo[88544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:53 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:53 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1" returned: 0 in 0.450s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:53 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 is being set with open permissions: ugo+rw
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:53 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1
Apr 13 20:32:53 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (ce48cf47-43c2-4dad-96f6-432aebebb16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfc209e-944f-4269-8821-1c6e8b24cef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfc209e-944f-4269-8821-1c6e8b24cef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1773501465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac194bfd-e694-47de-ba8c-6cd37be2c42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:53Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042f0567-de7d-41bb-af7b-c362eb32537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042f0567-de7d-41bb-af7b-c362eb32537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0d9676-6183-4001-babb-91bfe556b421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0d9676-6183-4001-babb-91bfe556b421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac194bfd-e694-47de-ba8c-6cd37be2c42b', 'volume_name': 'volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfba427-4717-4ce7-96fc-76e0315a2b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfba427-4717-4ce7-96fc-76e0315a2b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0596f422-92e3-41e7-ab17-946cb2d8ca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:53 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Volume ac194bfd-e694-47de-ba8c-6cd37be2c42b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b', 'volume_size': 1}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:53 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.458s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:53 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Deleted volume successfully.
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b4037b4e-4519-4865-9945-06c94969fb5a tempest-VolumesActionsTest-924411195 None] Lock "cinder-4452a508-0322-4054-bd26-49d0896b1c10-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:53 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1" returned: 0 in 0.415s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.185s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1528092861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29bc85a7-8a96-42a0-bfc4-aa107163f261,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fbc8e828b64ad99a49335e7b084076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:51Z,use_quota=True,user_id='e520130e2bc94237aa27dcb0bd6597ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Creating volume 29bc85a7-8a96-42a0-bfc4-aa107163f261 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:53 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:53 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-32f9311b-2845-4385-bf0d-6e445756506e tempest-VolumesDeleteCascade-1009375877 None] Create snapshot completed successfully
Apr 13 20:32:53 devstack sudo[88553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261 1073741824
Apr 13 20:32:53 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-d8b25514-0421-4464-8acf-6ffa979af92c-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-d8b25514-0421-4464-8acf-6ffa979af92c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Performing cascade delete. {{(pid=82824) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-79daa7f7-62f7-4538-96bb-8811b7bbc1a5-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-79daa7f7-62f7-4538-96bb-8811b7bbc1a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-quobyte-d8b25514-0421-4464-8acf-6ffa979af92c" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-d8b25514-0421-4464-8acf-6ffa979af92c" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-quobyte-79daa7f7-62f7-4538-96bb-8811b7bbc1a5" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-79daa7f7-62f7-4538-96bb-8811b7bbc1a5" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Deleting offline snapshot 79daa7f7-62f7-4538-96bb-8811b7bbc1a5 of volume d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] snapshot_file for this snap is: volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0573bf18-465a-45a2-a19b-9daf2c7636f4]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:54 devstack sudo[88555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5
Apr 13 20:32:54 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:54 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261 1073741824" returned: 0 in 0.487s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:54 devstack sudo[88560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261
Apr 13 20:32:54 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:54 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5" returned: 0 in 0.491s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8b25514-0421-4464-8acf-6ffa979af92c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[2531db90-1632-4c2f-8e73-5355f79ed9a5]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:54 devstack sudo[88565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c
Apr 13 20:32:54 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:54 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261" returned: 0 in 0.421s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.927s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1516596308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c070877-04af-4c4d-a609-9941ceffbf8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934450f46917433eb4b6a07e36449234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:52Z,use_quota=True,user_id='1ea3cde94ce948858d17f13e4c522769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Creating volume 2c070877-04af-4c4d-a609-9941ceffbf8f {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:54 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0571ef3a-eaee-4935-8aa9-0e9543c88682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29bc85a7-8a96-42a0-bfc4-aa107163f261', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:54 devstack sudo[88568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f 1073741824
Apr 13 20:32:54 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda0c201-e9e4-4684-83d1-39f007de6867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:54 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Volume volume-29bc85a7-8a96-42a0-bfc4-aa107163f261 (29bc85a7-8a96-42a0-bfc4-aa107163f261): created successfully
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda0c201-e9e4-4684-83d1-39f007de6867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Flow 'volume_create_manager' (583785b2-b487-4ba0-b845-8e13136919f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:54 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-602ae2e3-51f1-4769-a99a-29fcd976262f tempest-VolumesListTestJSON-828878183 None] Created volume successfully.
Apr 13 20:32:55 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c" returned: 0 in 0.507s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac39bbc-8962-48f1-a881-71f9731bce61]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:55 devstack sudo[88576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1
Apr 13 20:32:55 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:55 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f 1073741824" returned: 0 in 0.491s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:55 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f
Apr 13 20:32:55 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:55 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1" returned: 0 in 0.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8b25514-0421-4464-8acf-6ffa979af92c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b89eaa-72bd-40cb-87cf-1fd5741fa836]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:55 devstack sudo[88584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5
Apr 13 20:32:55 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:55 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f" returned: 0 in 0.411s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.157s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1773501465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac194bfd-e694-47de-ba8c-6cd37be2c42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b43fe9a1fb483699e68b80b8480cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:53Z,use_quota=True,user_id='afe2b6cfa3a94d3e82bcda554dac73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Creating volume ac194bfd-e694-47de-ba8c-6cd37be2c42b {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:55 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e6fbca-feab-4d90-8c9f-06c8dbdfe3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c070877-04af-4c4d-a609-9941ceffbf8f', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ef7dea-006d-480f-b155-0cdecc032b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:55 devstack sudo[88586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b 1073741824
Apr 13 20:32:55 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:55 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Volume volume-2c070877-04af-4c4d-a609-9941ceffbf8f (2c070877-04af-4c4d-a609-9941ceffbf8f): created successfully
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ef7dea-006d-480f-b155-0cdecc032b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Flow 'volume_create_manager' (9fa7c0ce-88ae-45f5-975e-f4ed67dc9415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:55 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8fb291e1-45f5-442a-9804-d5409178a18a tempest-CinderUnicodeTest-1287774608 None] Created volume successfully.
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Flow 'volume_create_manager' (83ba336d-1b0a-4c3a-8760-e18e0f1508ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa448ca-a781-4863-a848-7e18098d37a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:56 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa448ca-a781-4863-a848-7e18098d37a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1814618804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9607a1c1-6fd5-4d76-857a-3d2d0472f238,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fbc8e828b64ad99a49335e7b084076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:56Z,use_quota=True,user_id='e520130e2bc94237aa27dcb0bd6597ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3363434b-f129-4bba-9473-c045b9fd8a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3363434b-f129-4bba-9473-c045b9fd8a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aaf7ecb-ef47-42bf-b008-1d221192939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aaf7ecb-ef47-42bf-b008-1d221192939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9607a1c1-6fd5-4d76-857a-3d2d0472f238', 'volume_name': 'volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8643ccaf-13fe-49cb-be7b-782dfe17ed23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8643ccaf-13fe-49cb-be7b-782dfe17ed23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b682c873-e0ec-407f-bddf-6907d58e974f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:56 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Volume 9607a1c1-6fd5-4d76-857a-3d2d0472f238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238', 'volume_size': 1}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5" returned: 0 in 0.561s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8b25514-0421-4464-8acf-6ffa979af92c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[3871330c-d6c2-4b68-9a37-96497894ec8e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:56 devstack sudo[88594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:56 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:56 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b 1073741824" returned: 0 in 0.568s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:56 devstack sudo[88596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b
Apr 13 20:32:56 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:56 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c" returned: 0 in 0.510s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:56 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b" returned: 0 in 0.405s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1814618804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9607a1c1-6fd5-4d76-857a-3d2d0472f238,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fbc8e828b64ad99a49335e7b084076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:56Z,use_quota=True,user_id='e520130e2bc94237aa27dcb0bd6597ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:32:56 devstack sudo[88602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Creating volume 9607a1c1-6fd5-4d76-857a-3d2d0472f238 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:32:56 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:32:56 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0596f422-92e3-41e7-ab17-946cb2d8ca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4447ca8c-8d2f-44f7-83c5-f367066aed2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:56 devstack sudo[88604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238 1073741824
Apr 13 20:32:56 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:56 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Volume volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b (ac194bfd-e694-47de-ba8c-6cd37be2c42b): created successfully
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4447ca8c-8d2f-44f7-83c5-f367066aed2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Flow 'volume_create_manager' (ce48cf47-43c2-4dad-96f6-432aebebb16c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:56 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3f3aeaf4-6c8e-4c32-8f29-046484052915 tempest-VolumesActionsTest-358394727 None] Created volume successfully.
Apr 13 20:32:57 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5" returned: 0 in 0.459s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:57 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5
Apr 13 20:32:57 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:57 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238 1073741824" returned: 0 in 0.502s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:57 devstack sudo[88614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238
Apr 13 20:32:57 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:57 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.79daa7f7-62f7-4538-96bb-8811b7bbc1a5" returned: 0 in 0.402s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b25514-0421-4464-8acf-6ffa979af92c /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 -F qcow2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:57 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b25514-0421-4464-8acf-6ffa979af92c /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 -F qcow2
Apr 13 20:32:57 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:57 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238" returned: 0 in 0.416s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.390s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_service.periodic_task [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82824) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b682c873-e0ec-407f-bddf-6907d58e974f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8475bc8-07cf-4192-a46d-718f22980c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] Creating offline snapshot dc5ed323-655e-4cc6-96b0-7776564aeb2a of volume 2c070877-04af-4c4d-a609-9941ceffbf8f {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:32:57 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:57 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dadca1-a690-4621-947e-74524ae93a13]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:57 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Volume volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238 (9607a1c1-6fd5-4d76-857a-3d2d0472f238): created successfully
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8475bc8-07cf-4192-a46d-718f22980c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Flow 'volume_create_manager' (83ba336d-1b0a-4c3a-8760-e18e0f1508ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:57 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-93aa189c-353a-458c-a8d3-c2c724e97b2b tempest-VolumesListTestJSON-828878183 None] Created volume successfully.
Apr 13 20:32:57 devstack sudo[88622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f
Apr 13 20:32:57 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:57 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b25514-0421-4464-8acf-6ffa979af92c /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 -F qcow2" returned: 0 in 0.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-79daa7f7-62f7-4538-96bb-8811b7bbc1a5" released by "_delete_snapshot" :: held 3.984s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-d8b25514-0421-4464-8acf-6ffa979af92c" released by "delete_snapshot" :: held 3.997s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Created reservations ['992d449a-5b58-48a8-925e-2ccd0badd402', '084c8803-f9e9-40fd-8a26-fa1b354e237d', '8e9926dd-a59b-4500-85e6-a306c8b88b44', '11291855-588c-4ef3-a436-e7349c1939d2'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:58 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Delete snapshot completed successfully.
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-79daa7f7-62f7-4538-96bb-8811b7bbc1a5-delete_snapshot" released by "delete_snapshot" :: held 4.117s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-d877c9ef-e72e-403d-a22b-8f16ca7207a1-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-d877c9ef-e72e-403d-a22b-8f16ca7207a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-quobyte-d8b25514-0421-4464-8acf-6ffa979af92c" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-d8b25514-0421-4464-8acf-6ffa979af92c" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-quobyte-d877c9ef-e72e-403d-a22b-8f16ca7207a1" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-d877c9ef-e72e-403d-a22b-8f16ca7207a1" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Deleting offline snapshot d877c9ef-e72e-403d-a22b-8f16ca7207a1 of volume d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] snapshot_file for this snap is: volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2fd44f-e5fc-4eb3-b5f3-241a956ef795]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:58 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.562s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Acquiring lock "cinder-ac194bfd-e694-47de-ba8c-6cd37be2c42b-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Lock "cinder-ac194bfd-e694-47de-ba8c-6cd37be2c42b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Acquiring lock "cinder-quobyte-ac194bfd-e694-47de-ba8c-6cd37be2c42b" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Lock "cinder-quobyte-ac194bfd-e694-47de-ba8c-6cd37be2c42b" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc4c987-e28b-44c0-ac2d-3eb00e086003]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:58 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1
Apr 13 20:32:58 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:58 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f" returned: 0 in 0.691s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:58 devstack sudo[88632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b
Apr 13 20:32:58 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:58 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a 1G
Apr 13 20:32:58 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Flow 'volume_create_manager' (e30a9673-c47c-4af5-95ee-dd351de7a9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b732b3-40a6-4c84-aeb2-7729c06220bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b732b3-40a6-4c84-aeb2-7729c06220bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-63643398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5cfe8b3-c081-4df6-bda9-90a8b510e85f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fbc8e828b64ad99a49335e7b084076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:58Z,use_quota=True,user_id='e520130e2bc94237aa27dcb0bd6597ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba6ec69-a77c-4207-92af-608f2decac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba6ec69-a77c-4207-92af-608f2decac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954e601e-40a0-431a-868a-d77e24c98625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954e601e-40a0-431a-868a-d77e24c98625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5cfe8b3-c081-4df6-bda9-90a8b510e85f', 'volume_name': 'volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c824baf-2241-4d5f-9712-88878bee9345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c824baf-2241-4d5f-9712-88878bee9345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1cdd20-3901-43f0-8e5d-f1625670e637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:32:58 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Volume c5cfe8b3-c081-4df6-bda9-90a8b510e85f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f', 'volume_size': 1}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:58 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1" returned: 0 in 0.545s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8b25514-0421-4464-8acf-6ffa979af92c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[81da55d7-47a4-4df0-9ce1-bedf7f3968a8]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:58 devstack sudo[88643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c
Apr 13 20:32:58 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:58 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b" returned: 0 in 0.556s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:58 devstack sudo[88648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b
Apr 13 20:32:58 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:58 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a 1G" returned: 0 in 0.541s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c070877-04af-4c4d-a609-9941ceffbf8f -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:58 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c070877-04af-4c4d-a609-9941ceffbf8f -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a
Apr 13 20:32:58 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:59 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c" returned: 0 in 0.491s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:59 devstack sudo[88656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1
Apr 13 20:32:59 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:59 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac194bfd-e694-47de-ba8c-6cd37be2c42b" returned: 0 in 0.432s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Lock "cinder-quobyte-ac194bfd-e694-47de-ba8c-6cd37be2c42b" released by "delete_volume" :: held 1.025s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Created reservations ['005edadd-c62d-4dfd-9d23-d449cc988138', 'fb92807b-356d-4713-989a-99d1aed5e746', 'ea6dd016-ca99-4fb8-9fab-454f5bfdd2af', 'df26bd4b-e3ad-4319-a3cb-6ddb6e730b7d'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:32:59 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c070877-04af-4c4d-a609-9941ceffbf8f -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a" returned: 0 in 0.453s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:59 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a is being set with open permissions: ugo+rw
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:59 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a
Apr 13 20:32:59 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:59 devstack sudo[88664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:32:59 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:59 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1" returned: 0 in 0.486s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:59 devstack sudo[88670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1
Apr 13 20:32:59 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:59 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a" returned: 0 in 0.425s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:32:59 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.429s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:32:59 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.info
Apr 13 20:32:59 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:32:59 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Deleted volume successfully.
Apr 13 20:32:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-27fc05eb-ccd5-47c6-99a5-58e7ff188546 tempest-VolumesActionsTest-358394727 None] Lock "cinder-ac194bfd-e694-47de-ba8c-6cd37be2c42b-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:00 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c.d877c9ef-e72e-403d-a22b-8f16ca7207a1" returned: 0 in 0.425s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-d877c9ef-e72e-403d-a22b-8f16ca7207a1" released by "_delete_snapshot" :: held 1.994s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-d8b25514-0421-4464-8acf-6ffa979af92c" released by "delete_snapshot" :: held 2.004s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Created reservations ['e1d39918-c3ae-4170-a742-19a03f90bc2a', 'a920fa0e-5b77-49dc-8b2e-b7fbe0868286', '8ffc70c9-231d-4665-9d94-53785f736e76', '90d8c598-f4bc-413a-8894-cbd10652fb83'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:00 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.info" returned: 0 in 0.453s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:00 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.info is being set with open permissions: ugo+rw
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:00 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Delete snapshot completed successfully.
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-d877c9ef-e72e-403d-a22b-8f16ca7207a1-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Snapshots deleted, issuing volume delete {{(pid=82824) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-quobyte-d8b25514-0421-4464-8acf-6ffa979af92c" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:00 devstack sudo[88677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.info
Apr 13 20:33:00 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-d8b25514-0421-4464-8acf-6ffa979af92c" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[83739e41-e269-41ec-bf87-2fe184ea355b]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:00 devstack sudo[88679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c
Apr 13 20:33:00 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:00 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.info" returned: 0 in 0.461s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.128s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-63643398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5cfe8b3-c081-4df6-bda9-90a8b510e85f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fbc8e828b64ad99a49335e7b084076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:32:58Z,use_quota=True,user_id='e520130e2bc94237aa27dcb0bd6597ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Creating volume c5cfe8b3-c081-4df6-bda9-90a8b510e85f {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:00 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:00 devstack sudo[88685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f 1073741824
Apr 13 20:33:00 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:00 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-7d57b39f-8e0e-480c-8575-a495c6eb00b7 tempest-CinderUnicodeTest-1287774608 None] Create snapshot completed successfully
Apr 13 20:33:00 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c" returned: 0 in 0.511s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:00 devstack sudo[88687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c
Apr 13 20:33:00 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:01 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:01 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b25514-0421-4464-8acf-6ffa979af92c" returned: 0 in 0.448s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f 1073741824" returned: 0 in 0.544s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-d8b25514-0421-4464-8acf-6ffa979af92c" released by "delete_volume" :: held 1.006s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:01 devstack sudo[88693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f
Apr 13 20:33:01 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Created reservations ['36721b40-2518-423b-8550-7b72fbafa4cb', 'da04d09e-8557-4301-a0c9-9cc85c6d6885', '72f1a990-a4be-4cec-904e-3fd515939dd0', 'e0f2f439-d2c8-4e91-b2d7-dee8e1d7fa34'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:01 devstack sudo[88695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:01 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "cinder-dc5ed323-655e-4cc6-96b0-7776564aeb2a-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-dc5ed323-655e-4cc6-96b0-7776564aeb2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "cinder-quobyte-2c070877-04af-4c4d-a609-9941ceffbf8f" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-quobyte-2c070877-04af-4c4d-a609-9941ceffbf8f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "cinder-quobyte-dc5ed323-655e-4cc6-96b0-7776564aeb2a" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-quobyte-dc5ed323-655e-4cc6-96b0-7776564aeb2a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Deleting offline snapshot dc5ed323-655e-4cc6-96b0-7776564aeb2a of volume 2c070877-04af-4c4d-a609-9941ceffbf8f {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] snapshot_file for this snap is: volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada4e6dc-4a28-47a6-844e-3d874d13b723]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:01 devstack sudo[88697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a
Apr 13 20:33:01 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:01 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f" returned: 0 in 0.445s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1cdd20-3901-43f0-8e5d-f1625670e637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8ff69c-9748-4dff-98e3-d73c31883c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:01 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Volume volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f (c5cfe8b3-c081-4df6-bda9-90a8b510e85f): created successfully
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8ff69c-9748-4dff-98e3-d73c31883c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Flow 'volume_create_manager' (e30a9673-c47c-4af5-95ee-dd351de7a9bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:01 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0073ca64-454c-40bb-be4b-798db252e992 tempest-VolumesListTestJSON-828878183 None] Created volume successfully.
Apr 13 20:33:01 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.519s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:01 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Deleted volume successfully.
Apr 13 20:33:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2f2dc2b-daec-47f9-8cc8-6b363eeada49 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-d8b25514-0421-4464-8acf-6ffa979af92c-delete_volume" released by "delete_volume" :: held 8.038s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:02 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a" returned: 0 in 0.549s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c070877-04af-4c4d-a609-9941ceffbf8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c973bb-f587-4e6e-b123-61f4f739e089]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:02 devstack sudo[88705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f
Apr 13 20:33:02 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:02 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f" returned: 0 in 0.552s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:02 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a
Apr 13 20:33:02 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Flow 'volume_create_manager' (54b7ce9c-a7b1-4f3e-9f17-de6465b9f6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccd101f-90fb-4ffa-8552-a89d18f5395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccd101f-90fb-4ffa-8552-a89d18f5395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1732791354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fb8625-497d-4e19-ba8b-a6f15b070042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bec8ea864664de19b5db96cdd1d5658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:03Z,use_quota=True,user_id='b48cb77efb4e409985f1cc08d3482b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3738e8f-821b-4a0a-b0c6-52a227374e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3738e8f-821b-4a0a-b0c6-52a227374e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd24ad94-1cff-4d01-9ed9-a96dd8b43319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd24ad94-1cff-4d01-9ed9-a96dd8b43319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32fb8625-497d-4e19-ba8b-a6f15b070042', 'volume_name': 'volume-32fb8625-497d-4e19-ba8b-a6f15b070042', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f26685-b198-4846-88a6-856c9af27643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f26685-b198-4846-88a6-856c9af27643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5e8b83-18a0-470c-80bd-96174d757809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:02 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Volume 32fb8625-497d-4e19-ba8b-a6f15b070042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32fb8625-497d-4e19-ba8b-a6f15b070042', 'volume_size': 1}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1732791354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fb8625-497d-4e19-ba8b-a6f15b070042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bec8ea864664de19b5db96cdd1d5658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:03Z,use_quota=True,user_id='b48cb77efb4e409985f1cc08d3482b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Creating volume 32fb8625-497d-4e19-ba8b-a6f15b070042 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:02 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:03 devstack sudo[88712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 1073741824
Apr 13 20:33:03 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:03 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a" returned: 0 in 0.613s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:03 devstack sudo[88717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a
Apr 13 20:33:03 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:03 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 1073741824" returned: 0 in 0.653s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:03 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042
Apr 13 20:33:03 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:03 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f.dc5ed323-655e-4cc6-96b0-7776564aeb2a" returned: 0 in 0.558s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-quobyte-dc5ed323-655e-4cc6-96b0-7776564aeb2a" released by "_delete_snapshot" :: held 2.344s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-quobyte-2c070877-04af-4c4d-a609-9941ceffbf8f" released by "delete_snapshot" :: held 2.356s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:03 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Created reservations ['e3240860-9974-44b0-90fc-fba7886f9b14', 'a1abb034-bcfa-4925-b2f7-9d1f753d593d', '11cc4c36-3b9a-4a3d-9a10-9a5edb951b7e', 'b6969b26-8a67-4364-bb8b-332a64f555c5'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:03 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Delete snapshot completed successfully.
Apr 13 20:33:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50fa4f42-9b9a-4799-a448-8e9ab6e3c389 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-dc5ed323-655e-4cc6-96b0-7776564aeb2a-delete_snapshot" released by "delete_snapshot" :: held 2.451s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:04 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042" returned: 0 in 0.525s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5e8b83-18a0-470c-80bd-96174d757809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32fb8625-497d-4e19-ba8b-a6f15b070042', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319f1b36-45b2-4093-8abf-a1f27f2b112d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:04 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Volume volume-32fb8625-497d-4e19-ba8b-a6f15b070042 (32fb8625-497d-4e19-ba8b-a6f15b070042): created successfully
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319f1b36-45b2-4093-8abf-a1f27f2b112d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Flow 'volume_create_manager' (54b7ce9c-a7b1-4f3e-9f17-de6465b9f6c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:04 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-279f5a27-e0b7-48cf-aa59-f802078c6167 tempest-VolumesDeleteCascade-1009375877 None] Created volume successfully.
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "cinder-2c070877-04af-4c4d-a609-9941ceffbf8f-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-2c070877-04af-4c4d-a609-9941ceffbf8f-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "cinder-quobyte-2c070877-04af-4c4d-a609-9941ceffbf8f" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-quobyte-2c070877-04af-4c4d-a609-9941ceffbf8f" acquired by "delete_volume" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Acquiring lock "cinder-c5cfe8b3-c081-4df6-bda9-90a8b510e85f-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd837d6-d9b2-4ab5-b924-9ef4a5b358a7]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Lock "cinder-c5cfe8b3-c081-4df6-bda9-90a8b510e85f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Acquiring lock "cinder-quobyte-c5cfe8b3-c081-4df6-bda9-90a8b510e85f" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Lock "cinder-quobyte-c5cfe8b3-c081-4df6-bda9-90a8b510e85f" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df9d227-0a94-410d-aa26-9e4cc53ee414]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:04 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f
Apr 13 20:33:04 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:04 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f
Apr 13 20:33:04 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] Creating offline snapshot ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 of volume 32fb8625-497d-4e19-ba8b-a6f15b070042 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[b262ba71-5240-46b2-817f-f143214bedc3]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:05 devstack sudo[88732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042
Apr 13 20:33:05 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:05 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f" returned: 0 in 0.574s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:05 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f
Apr 13 20:33:05 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:05 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f" returned: 0 in 0.565s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:05 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f
Apr 13 20:33:05 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:05 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042" returned: 0 in 0.575s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:05 devstack sudo[88747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 1G
Apr 13 20:33:05 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:05 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2c070877-04af-4c4d-a609-9941ceffbf8f" returned: 0 in 0.501s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-quobyte-2c070877-04af-4c4d-a609-9941ceffbf8f" released by "delete_volume" :: held 1.124s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Created reservations ['762841a2-9424-4b87-a057-524a94af4819', '493e9d47-15a8-4444-8173-fd10cb7483ae', 'c3104507-8d2e-4687-a509-817a4cb4db3b', '84171fd5-105f-4a74-8710-dc756e324361'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:05 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c5cfe8b3-c081-4df6-bda9-90a8b510e85f" returned: 0 in 0.569s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:05 devstack sudo[88751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:05 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Lock "cinder-quobyte-c5cfe8b3-c081-4df6-bda9-90a8b510e85f" released by "delete_volume" :: held 1.156s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:05 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Created reservations ['4c2fd373-8de0-4a26-b004-fe7f0b6efa92', '8b2b0922-12e0-4092-96a5-0df39f512328', '09d8c216-2726-477d-90e1-7aea68a1e576', '90efd62e-5508-4855-9fe2-b6126933f216'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:06 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:06 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:06 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 1G" returned: 0 in 0.598s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32fb8625-497d-4e19-ba8b-a6f15b070042 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:06 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32fb8625-497d-4e19-ba8b-a6f15b070042 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397
Apr 13 20:33:06 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:06 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.501s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:06 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Deleted volume successfully.
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-20b06310-80ac-44b8-852d-116377a39b03 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-2c070877-04af-4c4d-a609-9941ceffbf8f-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:06 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.516s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:06 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Deleted volume successfully.
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4d431c5a-9cec-4fa6-839c-d1a7e2afbb3f tempest-VolumesListTestJSON-828878183 None] Lock "cinder-c5cfe8b3-c081-4df6-bda9-90a8b510e85f-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:06 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32fb8625-497d-4e19-ba8b-a6f15b070042 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:06 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 is being set with open permissions: ugo+rw
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:06 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397
Apr 13 20:33:06 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "cinder-eb883005-68b2-45f2-8c9c-a511b32a2e02-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-eb883005-68b2-45f2-8c9c-a511b32a2e02-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "cinder-quobyte-eb883005-68b2-45f2-8c9c-a511b32a2e02" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-quobyte-eb883005-68b2-45f2-8c9c-a511b32a2e02" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87759bf-37b5-4600-8975-a1936b4e2c84]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Acquiring lock "cinder-9607a1c1-6fd5-4d76-857a-3d2d0472f238-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Lock "cinder-9607a1c1-6fd5-4d76-857a-3d2d0472f238-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Acquiring lock "cinder-quobyte-9607a1c1-6fd5-4d76-857a-3d2d0472f238" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Lock "cinder-quobyte-9607a1c1-6fd5-4d76-857a-3d2d0472f238" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:07 devstack sudo[88768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02
Apr 13 20:33:07 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaa925f-8047-4ac3-8829-f34e1ab7f124]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:07 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238
Apr 13 20:33:07 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:07 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397" returned: 0 in 0.551s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:07 devstack sudo[88773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.info
Apr 13 20:33:07 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:07 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02" returned: 0 in 0.562s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:07 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02
Apr 13 20:33:07 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:07 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238" returned: 0 in 0.681s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:07 devstack sudo[88786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238
Apr 13 20:33:07 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:07 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.info" returned: 0 in 0.461s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:07 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.info is being set with open permissions: ugo+rw
Apr 13 20:33:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:07 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.info
Apr 13 20:33:07 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:08 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-eb883005-68b2-45f2-8c9c-a511b32a2e02" returned: 0 in 0.513s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-quobyte-eb883005-68b2-45f2-8c9c-a511b32a2e02" released by "delete_volume" :: held 1.099s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Created reservations ['43a6733d-1621-43fb-9a43-001f2aad5f1e', 'ef11c8cd-05e6-42fb-aee9-9e888aca87e8', 'c5cd67db-651d-43a3-ac5f-1eea993ed0c3', '4270250e-20e8-45d9-a853-662153c4954e'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:08 devstack sudo[88791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:08 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:08 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9607a1c1-6fd5-4d76-857a-3d2d0472f238" returned: 0 in 0.486s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Lock "cinder-quobyte-9607a1c1-6fd5-4d76-857a-3d2d0472f238" released by "delete_volume" :: held 1.194s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Created reservations ['6a914be7-a87f-4e0b-9366-0b3cc3888c52', 'a04b59ff-57bc-4633-b567-517d4080bbcf', 'b1552ea8-fedc-4ebd-bc13-509a2bf57c51', 'f0be3e54-2d72-41fc-95cd-56d023d9bbc7'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:08 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.info" returned: 0 in 0.502s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.228s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:08 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-ca75d0ad-0bec-4341-bb2c-54170be6cab8 tempest-VolumesDeleteCascade-1009375877 None] Create snapshot completed successfully
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:08 devstack sudo[88795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:08 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:08 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.501s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:08 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Deleted volume successfully.
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b9dffd2f-fa1e-47a3-9983-f36d586e4dc2 tempest-CinderUnicodeTest-1287774608 None] Lock "cinder-eb883005-68b2-45f2-8c9c-a511b32a2e02-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:08 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.448s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:08 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Deleted volume successfully.
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-00e0abdb-709a-4ecb-a57b-c77097dfca60 tempest-VolumesListTestJSON-828878183 None] Lock "cinder-9607a1c1-6fd5-4d76-857a-3d2d0472f238-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Flow 'volume_create_manager' (aded9fd5-c01e-4fb7-8748-270f6560c421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f38451-77c3-4dc0-bd1c-6ea397b505c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f38451-77c3-4dc0-bd1c-6ea397b505c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1178042665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb34f5c-1e7a-420c-a8b6-c96592927a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ee4442719a42df84c20fba0c3459b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:09Z,use_quota=True,user_id='33711d35e9d842019e7406ec2734ddcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3886981a-f8ea-4571-96b1-9f4aecc15382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3886981a-f8ea-4571-96b1-9f4aecc15382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21dc4a55-b43e-4139-9173-160bd2c9742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21dc4a55-b43e-4139-9173-160bd2c9742e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb34f5c-1e7a-420c-a8b6-c96592927a21', 'volume_name': 'volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407d7d7f-5ea1-4433-8848-2efe05f1edb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407d7d7f-5ea1-4433-8848-2efe05f1edb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fb3147-2794-4716-8e9a-9d40093eabe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:08 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Volume dfb34f5c-1e7a-420c-a8b6-c96592927a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21', 'volume_size': 1}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1178042665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb34f5c-1e7a-420c-a8b6-c96592927a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ee4442719a42df84c20fba0c3459b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:09Z,use_quota=True,user_id='33711d35e9d842019e7406ec2734ddcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Creating volume dfb34f5c-1e7a-420c-a8b6-c96592927a21 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:08 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:08 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21 1073741824
Apr 13 20:33:08 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Acquiring lock "cinder-29bc85a7-8a96-42a0-bfc4-aa107163f261-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Lock "cinder-29bc85a7-8a96-42a0-bfc4-aa107163f261-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:09 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21 1073741824" returned: 0 in 0.641s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Acquiring lock "cinder-quobyte-29bc85a7-8a96-42a0-bfc4-aa107163f261" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:09 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21
Apr 13 20:33:09 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Flow 'volume_create_manager' (7ccb7dfc-5cfd-4581-9dc2-ba69cc81152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4104c752-d240-483e-b095-bf950822239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Lock "cinder-quobyte-29bc85a7-8a96-42a0-bfc4-aa107163f261" acquired by "delete_volume" :: waited 0.081s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a46d5f-4b0d-4c2e-b4e2-a8f7b7847255]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4104c752-d240-483e-b095-bf950822239a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1536519234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef852c09-c509-49a9-a371-2db909acdc6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bec8ea864664de19b5db96cdd1d5658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:10Z,use_quota=True,user_id='b48cb77efb4e409985f1cc08d3482b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76654524-d253-42fd-94eb-78856fd84b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76654524-d253-42fd-94eb-78856fd84b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69caac0b-c03b-4b45-a679-44577cbba8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69caac0b-c03b-4b45-a679-44577cbba8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ef852c09-c509-49a9-a371-2db909acdc6a', 'volume_name': 'volume-ef852c09-c509-49a9-a371-2db909acdc6a', 'volume_size': 1, 'snapshot_id': 'ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9351f539-95e2-416d-b3d6-b6b3798f10f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9351f539-95e2-416d-b3d6-b6b3798f10f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2846bb-42f3-4b71-99aa-774e3e648d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:09 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Volume ef852c09-c509-49a9-a371-2db909acdc6a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ef852c09-c509-49a9-a371-2db909acdc6a', 'volume_size': 1, 'snapshot_id': 'ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397'}
Apr 13 20:33:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:09 devstack sudo[88807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261
Apr 13 20:33:09 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:10 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21" returned: 0 in 0.518s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.380s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-quobyte-ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397-ef852c09-c509-49a9-a371-2db909acdc6a" by "_create_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fb3147-2794-4716-8e9a-9d40093eabe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1cf9e4-295f-4652-b93e-b13a6f653552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397-ef852c09-c509-49a9-a371-2db909acdc6a" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Creating volume ef852c09-c509-49a9-a371-2db909acdc6a from snapshot ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 {{(pid=82824) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-quobyte-ef852c09-c509-49a9-a371-2db909acdc6a" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:10 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Volume volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21 (dfb34f5c-1e7a-420c-a8b6-c96592927a21): created successfully
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1cf9e4-295f-4652-b93e-b13a6f653552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Flow 'volume_create_manager' (aded9fd5-c01e-4fb7-8748-270f6560c421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:10 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-04f6a50d-b1c9-44d0-965b-8afb65435f49 tempest-VolumesListAdminTestJSON-1514424190 None] Created volume successfully.
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-ef852c09-c509-49a9-a371-2db909acdc6a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] snapshot: ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397, volume: ef852c09-c509-49a9-a371-2db909acdc6a,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5377d18-ad7c-4fd9-830d-e0abd69d7994]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:10 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261" returned: 0 in 0.579s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:10 devstack sudo[88814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261
Apr 13 20:33:10 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:10 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397
Apr 13 20:33:10 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:10 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-29bc85a7-8a96-42a0-bfc4-aa107163f261" returned: 0 in 0.475s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Lock "cinder-quobyte-29bc85a7-8a96-42a0-bfc4-aa107163f261" released by "delete_volume" :: held 1.081s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Created reservations ['5b222713-ffbd-4d2d-ac27-24dfff3b2ce8', '28ed521b-4a98-4bc1-aace-57d549bc5e31', '54c90a4a-54ba-4672-97a2-3cc12e44222d', 'ccb92eba-1d4b-4df5-9393-07112f1a6d1c'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:10 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397" returned: 0 in 0.599s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32fb8625-497d-4e19-ba8b-a6f15b070042(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[4118e319-79a0-480e-a22c-04fbbae33d10]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:10 devstack sudo[88828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:10 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:10 devstack sudo[88827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042
Apr 13 20:33:10 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Flow 'volume_create_manager' (5a2133ae-a19d-402d-860c-4b263b96bb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1564dbbf-f66f-47fa-a721-e3684d53008a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1564dbbf-f66f-47fa-a721-e3684d53008a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-459486106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9abf3d6-4a42-4731-98e5-b0d3206738c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ee4442719a42df84c20fba0c3459b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:11Z,use_quota=True,user_id='33711d35e9d842019e7406ec2734ddcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb936203-fee0-4f47-a248-795e5fcf1b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb936203-fee0-4f47-a248-795e5fcf1b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7718d8-20e8-4566-bb8f-39adb2aa112e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7718d8-20e8-4566-bb8f-39adb2aa112e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9abf3d6-4a42-4731-98e5-b0d3206738c2', 'volume_name': 'volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba57039-a16d-4c05-ad2f-ad46278d9af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba57039-a16d-4c05-ad2f-ad46278d9af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aed091a-39e4-4b47-a2f6-3e1e793f6bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:11 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Volume a9abf3d6-4a42-4731-98e5-b0d3206738c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2', 'volume_size': 1}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:11 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.553s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:11 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Deleted volume successfully.
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-da131ffc-58ee-433a-b57c-716a88758ca2 tempest-VolumesListTestJSON-828878183 None] Lock "cinder-29bc85a7-8a96-42a0-bfc4-aa107163f261-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:11 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042" returned: 0 in 0.630s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:33:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:11 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a
Apr 13 20:33:11 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:13 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a" returned: 0 in 2.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:13 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd63c8df-eba9-4cb6-b828-ba38886a8b25]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:14 devstack sudo[88848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042
Apr 13 20:33:14 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:14 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042" returned: 0 in 0.702s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:33:14 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Converted 1024.00 MB image at 412.03 MB/s
Apr 13 20:33:14 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a is being set with open permissions: ugo+rw
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:14 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a
Apr 13 20:33:14 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:UPDATE=307,cinder:INSERT=111,cinder:SELECT=258,cinder:DELETE=27 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=213,cinder:UPDATE=298,cinder:DELETE=26,cinder:INSERT=46 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Flow 'volume_create_manager' (a06c12c2-eab5-433e-8faa-4729e7c5cd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1771fe-3052-4a42-b749-abf021a34097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1771fe-3052-4a42-b749-abf021a34097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-669713091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50f1cdc-8313-4b04-a8ff-11c2c5ab4238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f032e8d263d24bfab5dea0b52fae10c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:15Z,use_quota=True,user_id='5118287b0d194f549499ff449a99a994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f455855-2e65-4e8b-9fe4-6551dfd9145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f455855-2e65-4e8b-9fe4-6551dfd9145b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5de2241-fa7f-404c-bf54-41f412de1234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5de2241-fa7f-404c-bf54-41f412de1234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e50f1cdc-8313-4b04-a8ff-11c2c5ab4238', 'volume_name': 'volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141d03f6-220a-4f33-b639-e16f7ec4f042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141d03f6-220a-4f33-b639-e16f7ec4f042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc307e07-a680-4dcc-9d4b-012d97cfb30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:14 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Volume e50f1cdc-8313-4b04-a8ff-11c2c5ab4238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238', 'volume_size': 1}
Apr 13 20:33:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:15 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a" returned: 0 in 0.475s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-ef852c09-c509-49a9-a371-2db909acdc6a" released by "_copy_volume_from_snapshot" :: held 4.960s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397-ef852c09-c509-49a9-a371-2db909acdc6a" released by "_create_volume_from_snapshot" :: held 5.000s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.021s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.810s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-459486106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9abf3d6-4a42-4731-98e5-b0d3206738c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ee4442719a42df84c20fba0c3459b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:11Z,use_quota=True,user_id='33711d35e9d842019e7406ec2734ddcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Creating volume a9abf3d6-4a42-4731-98e5-b0d3206738c2 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:15 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:15 devstack sudo[88856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2 1073741824
Apr 13 20:33:15 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2846bb-42f3-4b71-99aa-774e3e648d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef852c09-c509-49a9-a371-2db909acdc6a', 'volume_size': 1, 'snapshot_id': 'ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066be416-5b74-46fd-9202-1c248d6cfbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:15 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Volume volume-ef852c09-c509-49a9-a371-2db909acdc6a (ef852c09-c509-49a9-a371-2db909acdc6a): created successfully
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066be416-5b74-46fd-9202-1c248d6cfbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Flow 'volume_create_manager' (7ccb7dfc-5cfd-4581-9dc2-ba69cc81152d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:15 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2201ca6f-6bec-41ad-9731-ed6803cf81d0 tempest-VolumesDeleteCascade-1009375877 None] Created volume successfully.
Apr 13 20:33:15 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2 1073741824" returned: 0 in 0.562s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:15 devstack sudo[88861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2
Apr 13 20:33:15 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-32fb8625-497d-4e19-ba8b-a6f15b070042-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-32fb8625-497d-4e19-ba8b-a6f15b070042-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Performing cascade delete. {{(pid=82824) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-quobyte-32fb8625-497d-4e19-ba8b-a6f15b070042" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:16 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-32fb8625-497d-4e19-ba8b-a6f15b070042" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-quobyte-ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2" returned: 0 in 0.500s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-669713091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50f1cdc-8313-4b04-a8ff-11c2c5ab4238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f032e8d263d24bfab5dea0b52fae10c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:15Z,use_quota=True,user_id='5118287b0d194f549499ff449a99a994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Creating volume e50f1cdc-8313-4b04-a8ff-11c2c5ab4238 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:16 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aed091a-39e4-4b47-a2f6-3e1e793f6bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32f230b-a15c-4b87-a135-c66625d21fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:16 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238 1073741824
Apr 13 20:33:16 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Deleting offline snapshot ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 of volume 32fb8625-497d-4e19-ba8b-a6f15b070042 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] snapshot_file for this snap is: volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:33:16 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Volume volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2 (a9abf3d6-4a42-4731-98e5-b0d3206738c2): created successfully
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32f230b-a15c-4b87-a135-c66625d21fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Flow 'volume_create_manager' (5a2133ae-a19d-402d-860c-4b263b96bb3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e28a7a-d91b-494a-bb97-36cdc323b4ff]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:16 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c26cd81f-d1c5-4995-892d-e9198882a35a tempest-VolumesListAdminTestJSON-1514424190 None] Created volume successfully.
Apr 13 20:33:16 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397
Apr 13 20:33:16 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:16 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238 1073741824" returned: 0 in 0.615s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:16 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397" returned: 0 in 0.612s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32fb8625-497d-4e19-ba8b-a6f15b070042(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23b974d-7c0d-4faa-84d7-7408d7056bda]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:16 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238
Apr 13 20:33:16 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:17 devstack sudo[88909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042
Apr 13 20:33:17 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Flow 'volume_create_manager' (4110e24e-a723-4ead-af35-1f10b7a39af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc4f69a-8ec4-4022-82fd-61edc6877a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc4f69a-8ec4-4022-82fd-61edc6877a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1864881518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1314f21e-6612-4b2b-8911-1d05eea3b2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ee4442719a42df84c20fba0c3459b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:17Z,use_quota=True,user_id='33711d35e9d842019e7406ec2734ddcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e210fbfd-06a9-457b-9641-0c79f35d7fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e210fbfd-06a9-457b-9641-0c79f35d7fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3817da83-102c-429e-a8e2-3311ad09c3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3817da83-102c-429e-a8e2-3311ad09c3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1314f21e-6612-4b2b-8911-1d05eea3b2e3', 'volume_name': 'volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3884107f-c5b0-4a5f-b6c8-7c7f30b2bcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3884107f-c5b0-4a5f-b6c8-7c7f30b2bcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603f8eba-ee09-4ff6-b9a2-b8306e521c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:17 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Volume 1314f21e-6612-4b2b-8911-1d05eea3b2e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3', 'volume_size': 1}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:17 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238" returned: 0 in 0.594s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1864881518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1314f21e-6612-4b2b-8911-1d05eea3b2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ee4442719a42df84c20fba0c3459b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:17Z,use_quota=True,user_id='33711d35e9d842019e7406ec2734ddcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Creating volume 1314f21e-6612-4b2b-8911-1d05eea3b2e3 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:17 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc307e07-a680-4dcc-9d4b-012d97cfb30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb99e18-6ee6-457d-af98-ea0137cf72aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:17 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Volume volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238 (e50f1cdc-8313-4b04-a8ff-11c2c5ab4238): created successfully
Apr 13 20:33:17 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3 1073741824
Apr 13 20:33:17 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb99e18-6ee6-457d-af98-ea0137cf72aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Flow 'volume_create_manager' (a06c12c2-eab5-433e-8faa-4729e7c5cd91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:17 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-682a52f7-0616-4919-8692-8f72fa90dc76 tempest-VolumesNegativeTest-383787104 None] Created volume successfully.
Apr 13 20:33:17 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042" returned: 0 in 0.675s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:17 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397
Apr 13 20:33:17 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:18 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3 1073741824" returned: 0 in 0.591s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:18 devstack sudo[88926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3
Apr 13 20:33:18 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:18 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397" returned: 0 in 0.566s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:18 devstack sudo[88928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397
Apr 13 20:33:18 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:18 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3" returned: 0 in 0.691s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603f8eba-ee09-4ff6-b9a2-b8306e521c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea6e57b-d862-4297-81f6-53f2780c98cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:18 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Volume volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3 (1314f21e-6612-4b2b-8911-1d05eea3b2e3): created successfully
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea6e57b-d862-4297-81f6-53f2780c98cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Flow 'volume_create_manager' (4110e24e-a723-4ead-af35-1f10b7a39af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:18 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-255c0fc0-3238-465b-b590-d9cd003ed74a tempest-VolumesListAdminTestJSON-1514424190 None] Created volume successfully.
Apr 13 20:33:18 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042.ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397" returned: 0 in 0.704s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397" released by "_delete_snapshot" :: held 2.622s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-32fb8625-497d-4e19-ba8b-a6f15b070042" released by "delete_snapshot" :: held 2.687s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:18 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Created reservations ['3e408a34-d059-4515-9268-88c1730a9855', '7cafb8a5-0950-4714-876b-e1c81f522113', '1f065aa1-b5d8-405f-bb57-71647a61992c', 'b189d95a-c949-456d-9d03-360e752bf242'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:19 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Delete snapshot completed successfully.
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-ce194d1a-d5d3-49b3-a7fe-f9a92a1dc397-delete_snapshot" released by "delete_snapshot" :: held 2.813s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Snapshots deleted, issuing volume delete {{(pid=82824) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-quobyte-32fb8625-497d-4e19-ba8b-a6f15b070042" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-32fb8625-497d-4e19-ba8b-a6f15b070042" acquired by "delete_volume" :: waited 0.005s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb7fce4-ac92-428d-8e13-c4da02566992]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:19 devstack sudo[88935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042
Apr 13 20:33:19 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:19 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042" returned: 0 in 0.680s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:19 devstack sudo[88942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042
Apr 13 20:33:19 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Flow 'volume_create_manager' (504a6ce5-944d-440e-8420-87a6226b7b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d133d927-da51-4aaf-838f-189f954c89c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d133d927-da51-4aaf-838f-189f954c89c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8745af0a-f8a5-4642-8af6-cfd12e7b38d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02849b0da18a4b83a503f9ef618a03c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:20Z,use_quota=True,user_id='377fda1725f745afaf6b4f23dfe3346f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9dee4b-221b-4817-b025-91b3cf1e9eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9dee4b-221b-4817-b025-91b3cf1e9eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce5fff1-b364-4111-b446-044f6208c41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce5fff1-b364-4111-b446-044f6208c41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8745af0a-f8a5-4642-8af6-cfd12e7b38d7', 'volume_name': 'volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445765f7-a78e-4cbd-a24e-72f3738dfef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445765f7-a78e-4cbd-a24e-72f3738dfef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adad4d1-0188-42ef-8988-5543222f467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:19 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Volume 8745af0a-f8a5-4642-8af6-cfd12e7b38d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7', 'volume_size': 1}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8745af0a-f8a5-4642-8af6-cfd12e7b38d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02849b0da18a4b83a503f9ef618a03c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:20Z,use_quota=True,user_id='377fda1725f745afaf6b4f23dfe3346f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Creating volume 8745af0a-f8a5-4642-8af6-cfd12e7b38d7 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:19 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:20 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7 1073741824
Apr 13 20:33:20 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:20 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32fb8625-497d-4e19-ba8b-a6f15b070042" returned: 0 in 0.564s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-32fb8625-497d-4e19-ba8b-a6f15b070042" released by "delete_volume" :: held 1.278s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Created reservations ['f902b2f8-b4eb-4d51-8b1a-4f37f0d080f9', 'ca3d0e92-a5cb-43d5-95ce-57bb85c2a35b', '5ba8339a-dbc1-4683-bbc9-b053f8d0e03f', '1063faec-df20-4556-b0e8-0b3d330937d3'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:20 devstack sudo[88950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:20 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:20 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7 1073741824" returned: 0 in 0.607s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-ef852c09-c509-49a9-a371-2db909acdc6a-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-ef852c09-c509-49a9-a371-2db909acdc6a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "cinder-quobyte-ef852c09-c509-49a9-a371-2db909acdc6a" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-ef852c09-c509-49a9-a371-2db909acdc6a" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:20 devstack sudo[88952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7
Apr 13 20:33:20 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b70edab-8fba-4c8b-88e0-ef37c100874c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:20 devstack sudo[88954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a
Apr 13 20:33:20 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:20 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.603s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:20 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:21 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Deleted volume successfully.
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6fdb5e98-4b52-4bea-b8f9-50c3ea4ab711 tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-32fb8625-497d-4e19-ba8b-a6f15b070042-delete_volume" released by "delete_volume" :: held 4.844s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:21 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7" returned: 0 in 0.619s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adad4d1-0188-42ef-8988-5543222f467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879339b3-6371-4b99-ad27-e6a510011266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:21 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Volume volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7 (8745af0a-f8a5-4642-8af6-cfd12e7b38d7): created successfully
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879339b3-6371-4b99-ad27-e6a510011266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Flow 'volume_create_manager' (504a6ce5-944d-440e-8420-87a6226b7b8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:21 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3165e949-1101-4ea7-9e8f-cf8f0723e1d3 tempest-VolumesListAdminTestJSON-1195846295 None] Created volume successfully.
Apr 13 20:33:21 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a" returned: 0 in 0.615s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:21 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a
Apr 13 20:33:21 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:21 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ef852c09-c509-49a9-a371-2db909acdc6a" returned: 0 in 0.470s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-quobyte-ef852c09-c509-49a9-a371-2db909acdc6a" released by "delete_volume" :: held 1.107s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Created reservations ['c834a166-f8e8-4e64-809b-84262aba0e3e', 'b9b835e3-0117-43ab-a018-08299e2ffacd', '90e7dd47-5992-47fd-92bc-37cd52afe85c', 'bde53a17-6d39-4978-81cb-75a211cdb066'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:21 devstack sudo[88964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:21 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Acquiring lock "cinder-8745af0a-f8a5-4642-8af6-cfd12e7b38d7-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Lock "cinder-8745af0a-f8a5-4642-8af6-cfd12e7b38d7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Acquiring lock "cinder-quobyte-8745af0a-f8a5-4642-8af6-cfd12e7b38d7" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Lock "cinder-quobyte-8745af0a-f8a5-4642-8af6-cfd12e7b38d7" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb29434-eb25-4fb9-9f36-b867abfe676d]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:22 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7
Apr 13 20:33:22 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "cinder-1314f21e-6612-4b2b-8911-1d05eea3b2e3-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-1314f21e-6612-4b2b-8911-1d05eea3b2e3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "cinder-quobyte-1314f21e-6612-4b2b-8911-1d05eea3b2e3" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-quobyte-1314f21e-6612-4b2b-8911-1d05eea3b2e3" acquired by "delete_volume" :: waited 0.025s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0114eca6-3aca-43de-b3d7-6d5d574adb78]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:22 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.577s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:22 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Deleted volume successfully.
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d52923ac-8c53-4263-8a1b-1fe1894d73bf tempest-VolumesDeleteCascade-1009375877 None] Lock "cinder-ef852c09-c509-49a9-a371-2db909acdc6a-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:22 devstack sudo[88969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3
Apr 13 20:33:22 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:22 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7" returned: 0 in 0.521s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:22 devstack sudo[88974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7
Apr 13 20:33:22 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:23 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3" returned: 0 in 0.714s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:23 devstack sudo[88979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3
Apr 13 20:33:23 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:23 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8745af0a-f8a5-4642-8af6-cfd12e7b38d7" returned: 0 in 0.505s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Lock "cinder-quobyte-8745af0a-f8a5-4642-8af6-cfd12e7b38d7" released by "delete_volume" :: held 1.047s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Created reservations ['5ebf7bb0-e467-412a-80c6-c5be1983ff36', 'd44d3497-b258-4dab-9db8-5914d54be0aa', '9fe079fc-3a33-41bc-85b0-c9b1117b25ce', 'e4e66f7d-91ec-4257-8232-47e52a0341f8'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:23 devstack sudo[88982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:23 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:23 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1314f21e-6612-4b2b-8911-1d05eea3b2e3" returned: 0 in 0.640s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-quobyte-1314f21e-6612-4b2b-8911-1d05eea3b2e3" released by "delete_volume" :: held 1.382s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Created reservations ['1539c17d-7233-4cb1-bf9a-af0d830a08f6', 'db1852b9-ccbf-438e-aaa9-4d2ac8921327', '6133f0e8-91b0-4fbb-9071-cbd93c90b294', 'f85665e7-e9de-4037-85e6-791e7d42acdd'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:23 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.510s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:23 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Deleted volume successfully.
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bd7c56e3-835c-4654-a878-06731394786b tempest-VolumesListAdminTestJSON-1195846295 None] Lock "cinder-8745af0a-f8a5-4642-8af6-cfd12e7b38d7-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:23 devstack sudo[88986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:23 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:24 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.451s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:24 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:24 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Deleted volume successfully.
Apr 13 20:33:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d41317ec-bfb1-4068-9a45-09b51e6ea302 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-1314f21e-6612-4b2b-8911-1d05eea3b2e3-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "cinder-a9abf3d6-4a42-4731-98e5-b0d3206738c2-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-a9abf3d6-4a42-4731-98e5-b0d3206738c2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "cinder-quobyte-a9abf3d6-4a42-4731-98e5-b0d3206738c2" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-quobyte-a9abf3d6-4a42-4731-98e5-b0d3206738c2" acquired by "delete_volume" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:24 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a01762-1446-4f1f-ac8c-6a69930276cf]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:24 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2
Apr 13 20:33:24 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:25 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2" returned: 0 in 0.725s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:25 devstack sudo[89007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2
Apr 13 20:33:25 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:25 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-a9abf3d6-4a42-4731-98e5-b0d3206738c2" returned: 0 in 0.598s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:25 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-quobyte-a9abf3d6-4a42-4731-98e5-b0d3206738c2" released by "delete_volume" :: held 1.353s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:25 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Created reservations ['f4331150-ac81-49af-8f14-a0c0092cac7f', '8f33c997-ee9d-4064-acaf-3366db8084dc', '70021837-ab3b-4910-a1ad-815d708e6f14', 'dd8b4f53-e756-4ee1-a3bd-fd4e25da8489'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:26 devstack sudo[89012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:26 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:26 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.636s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:26 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Deleted volume successfully.
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0bbf879b-f1f5-4c40-a8d1-43c6c55d6bf3 tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-a9abf3d6-4a42-4731-98e5-b0d3206738c2-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "cinder-dfb34f5c-1e7a-420c-a8b6-c96592927a21-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-dfb34f5c-1e7a-420c-a8b6-c96592927a21-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "cinder-quobyte-dfb34f5c-1e7a-420c-a8b6-c96592927a21" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-quobyte-dfb34f5c-1e7a-420c-a8b6-c96592927a21" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[83907e17-69a3-4e3d-92fa-5e1b9da88c66]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (65a19898-9f31-4b46-9195-472150f615fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8c0614-bd90-4695-ae2b-5819e182c5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8c0614-bd90-4695-ae2b-5819e182c5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-212519980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:27Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1379511-ae7c-437c-8c5d-2fc3eb1d3116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1379511-ae7c-437c-8c5d-2fc3eb1d3116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be9f85a-4e41-4b47-9183-bf5dbeb23c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be9f85a-4e41-4b47-9183-bf5dbeb23c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f', 'volume_name': 'volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:27 devstack sudo[89015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36927cb-d632-437b-bf6f-011306ab40ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:27 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36927cb-d632-437b-bf6f-011306ab40ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8e6bc7-48a1-40c4-9768-bd8646da8799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:27 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f', 'volume_size': 1}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-212519980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:27Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Creating volume bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:27 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:27 devstack sudo[89017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f 1073741824
Apr 13 20:33:27 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:27 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21" returned: 0 in 0.677s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:27 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21
Apr 13 20:33:27 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:27 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f 1073741824" returned: 0 in 0.618s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:27 devstack sudo[89028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f
Apr 13 20:33:27 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:28 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-dfb34f5c-1e7a-420c-a8b6-c96592927a21" returned: 0 in 0.558s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-quobyte-dfb34f5c-1e7a-420c-a8b6-c96592927a21" released by "delete_volume" :: held 1.263s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Created reservations ['59385c3d-d57a-45a1-84bc-0303a9a143c5', 'b364d72e-9c21-43d6-9704-e0ed6bad56cb', '70046d5a-53fc-4bdb-a94b-3464503b9f65', 'a6fc8bfb-53bd-40b2-8761-0eb20b29a4b7'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:28 devstack sudo[89033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:28 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:28 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f" returned: 0 in 0.658s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8e6bc7-48a1-40c4-9768-bd8646da8799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229ed9eb-4004-47b9-ae9e-6c936ba299ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:28 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f (bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f): created successfully
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229ed9eb-4004-47b9-ae9e-6c936ba299ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (65a19898-9f31-4b46-9195-472150f615fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:28 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5eaf113b-6276-4dc6-9849-b1d25c8c2ec5 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created volume successfully.
Apr 13 20:33:28 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.459s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:28 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Deleted volume successfully.
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-0a34a262-1d6e-4407-9a24-509a49e8deca tempest-VolumesListAdminTestJSON-1514424190 None] Lock "cinder-dfb34f5c-1e7a-420c-a8b6-c96592927a21-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Flow 'volume_create_manager' (ff89b497-6d2e-4b34-99e9-febf618d1522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5383fd-efa3-418e-aed3-084d85565a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5383fd-efa3-418e-aed3-084d85565a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-976970513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc7063c-481a-4ded-93cb-f0c8de111c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87401ce00b9c451dafa0e6a6f609f4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:29Z,use_quota=True,user_id='82b936570b684540b96328fc9989a053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a062b6-60f1-45e2-af74-913e78f17406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a062b6-60f1-45e2-af74-913e78f17406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff093cc-07c0-4d68-8518-71e94f24715e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff093cc-07c0-4d68-8518-71e94f24715e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc7063c-481a-4ded-93cb-f0c8de111c9e', 'volume_name': 'volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f93a2b-b01f-4646-85a2-10f670129c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f93a2b-b01f-4646-85a2-10f670129c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7f2828-f884-4a67-97c9-dd66e71f4e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:28 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Volume 7bc7063c-481a-4ded-93cb-f0c8de111c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e', 'volume_size': 1}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-976970513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc7063c-481a-4ded-93cb-f0c8de111c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87401ce00b9c451dafa0e6a6f609f4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:29Z,use_quota=True,user_id='82b936570b684540b96328fc9989a053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Creating volume 7bc7063c-481a-4ded-93cb-f0c8de111c9e {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:28 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:28 devstack sudo[89037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e 1073741824
Apr 13 20:33:28 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (485a5b28-99af-44ac-9d60-e870b58fa138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc3167d-fcb8-4aa0-8a2b-59a5d00cc66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc3167d-fcb8-4aa0-8a2b-59a5d00cc66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-799112088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bce8fb8-5c07-4575-be3d-c5cac136edd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:29Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e13de0-de35-4ea5-bd72-0b5df153f67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e13de0-de35-4ea5-bd72-0b5df153f67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60da426-bdeb-483e-99e4-2834db61fc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60da426-bdeb-483e-99e4-2834db61fc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bce8fb8-5c07-4575-be3d-c5cac136edd3', 'volume_name': 'volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e27bfda-9eae-4b1b-a0a4-9c015d03ba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e27bfda-9eae-4b1b-a0a4-9c015d03ba4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198c384b-cfb9-4f65-80da-a968bffdbaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume 3bce8fb8-5c07-4575-be3d-c5cac136edd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3', 'volume_size': 1}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e 1073741824" returned: 0 in 0.643s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:29 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e
Apr 13 20:33:29 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (5463a88d-de7b-4254-9fc2-45a6696475bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e921d2ed-b9df-4eda-8efd-2c523efc9c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e921d2ed-b9df-4eda-8efd-2c523efc9c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-463426881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f904df50-ac48-4196-87bc-985e65822251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:30Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4776155d-422c-4126-8122-b464742b6775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4776155d-422c-4126-8122-b464742b6775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c34a4cb-0851-49c8-ae7f-edb7524ab448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c34a4cb-0851-49c8-ae7f-edb7524ab448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f904df50-ac48-4196-87bc-985e65822251', 'volume_name': 'volume-f904df50-ac48-4196-87bc-985e65822251', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636f035c-7b21-41a2-8fff-b0a36c7baab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636f035c-7b21-41a2-8fff-b0a36c7baab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09d2ef6-77d8-4999-ad40-d5a0e5ca500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume f904df50-ac48-4196-87bc-985e65822251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f904df50-ac48-4196-87bc-985e65822251', 'volume_size': 1}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (bd1d5d76-c7ac-435d-ab45-5ef25de69200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42562cc6-3008-4679-bf10-264ec15a63ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42562cc6-3008-4679-bf10-264ec15a63ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1300512840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0990b0-073b-47e3-90ca-723401a0a0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:30Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527a1697-8f49-4657-8f28-2788b5d31d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527a1697-8f49-4657-8f28-2788b5d31d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b081a19c-8582-4882-a312-04b50821600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b081a19c-8582-4882-a312-04b50821600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0990b0-073b-47e3-90ca-723401a0a0a2', 'volume_name': 'volume-3c0990b0-073b-47e3-90ca-723401a0a0a2', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c91b2e7-4845-4af8-96dd-eb10849e0499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c91b2e7-4845-4af8-96dd-eb10849e0499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d9c34d-b7d9-482b-a69f-bc27a1ab1bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:29 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume 3c0990b0-073b-47e3-90ca-723401a0a0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0990b0-073b-47e3-90ca-723401a0a0a2', 'volume_size': 1}
Apr 13 20:33:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (f05a932b-7977-468b-8bff-c2368e232d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ce2d38-1bfa-4891-a8e7-5c0bbc55c6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ce2d38-1bfa-4891-a8e7-5c0bbc55c6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-250192991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff6c2a8-eb5d-4696-85da-bb3763b91c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:30Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c45a40d-c53e-4901-8464-a3ddfff96fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c45a40d-c53e-4901-8464-a3ddfff96fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32090ce7-6378-4ba0-bc4d-9e02b8da0463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32090ce7-6378-4ba0-bc4d-9e02b8da0463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff6c2a8-eb5d-4696-85da-bb3763b91c21', 'volume_name': 'volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac2738f-651e-4100-852c-ebe1f7e6acfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac2738f-651e-4100-852c-ebe1f7e6acfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c931de4a-e1e2-4ca1-9c1f-daadeb0fa53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:30 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume 4ff6c2a8-eb5d-4696-85da-bb3763b91c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21', 'volume_size': 1}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:30 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e" returned: 0 in 0.675s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-799112088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bce8fb8-5c07-4575-be3d-c5cac136edd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:29Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Creating volume 3bce8fb8-5c07-4575-be3d-c5cac136edd3 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:30 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7f2828-f884-4a67-97c9-dd66e71f4e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:30 devstack sudo[89046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3 1073741824
Apr 13 20:33:30 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01d1379-c8aa-427e-9fe4-1cc25ea0edca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:30 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Volume volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e (7bc7063c-481a-4ded-93cb-f0c8de111c9e): created successfully
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01d1379-c8aa-427e-9fe4-1cc25ea0edca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Flow 'volume_create_manager' (ff89b497-6d2e-4b34-99e9-febf618d1522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:30 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-47560363-1251-450b-a327-c1a7a11edce4 tempest-SnapshotDependencyTests-102566354 None] Created volume successfully.
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (e3a923b9-7571-4dc2-a813-8a483ce2fbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d8fd98-632e-4916-8e55-e110b049eb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d8fd98-632e-4916-8e55-e110b049eb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-457267903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd475731-7dd9-4e5e-9099-217c852cf42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:30Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cef65e8-3a2f-4e38-9147-51f4cbbe84f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cef65e8-3a2f-4e38-9147-51f4cbbe84f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04796e08-6da9-475e-9588-7c26885f7b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04796e08-6da9-475e-9588-7c26885f7b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd475731-7dd9-4e5e-9099-217c852cf42b', 'volume_name': 'volume-fd475731-7dd9-4e5e-9099-217c852cf42b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a1633b-3a03-45dc-83d7-6ed56a02d474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a1633b-3a03-45dc-83d7-6ed56a02d474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac4534a-c13c-4b3b-8956-721dbb3d4923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:30 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume fd475731-7dd9-4e5e-9099-217c852cf42b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd475731-7dd9-4e5e-9099-217c852cf42b', 'volume_size': 1}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:30 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3 1073741824" returned: 0 in 0.542s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:30 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3
Apr 13 20:33:30 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:31 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3" returned: 0 in 0.446s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-463426881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f904df50-ac48-4196-87bc-985e65822251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:30Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Creating volume f904df50-ac48-4196-87bc-985e65822251 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:31 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198c384b-cfb9-4f65-80da-a968bffdbaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b289e68-2751-4576-9cf5-c9a64afbba3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:31 devstack sudo[89057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251 1073741824
Apr 13 20:33:31 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:31 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3 (3bce8fb8-5c07-4575-be3d-c5cac136edd3): created successfully
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b289e68-2751-4576-9cf5-c9a64afbba3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (485a5b28-99af-44ac-9d60-e870b58fa138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b3af2b03-82b2-40bb-96ad-3e0cd8e8356e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created volume successfully.
Apr 13 20:33:31 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251 1073741824" returned: 0 in 0.536s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:31 devstack sudo[89062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251
Apr 13 20:33:31 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:32 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251" returned: 0 in 0.431s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.299s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1300512840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0990b0-073b-47e3-90ca-723401a0a0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:30Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Creating volume 3c0990b0-073b-47e3-90ca-723401a0a0a2 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:32 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:32 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2 1073741824
Apr 13 20:33:32 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09d2ef6-77d8-4999-ad40-d5a0e5ca500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f904df50-ac48-4196-87bc-985e65822251', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63431b6-cc85-410c-8216-dd6aaa513118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:32 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume volume-f904df50-ac48-4196-87bc-985e65822251 (f904df50-ac48-4196-87bc-985e65822251): created successfully
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63431b6-cc85-410c-8216-dd6aaa513118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (5463a88d-de7b-4254-9fc2-45a6696475bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:32 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5622aa1f-1e1b-4628-8641-0cf7b6b5e29c tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created volume successfully.
Apr 13 20:33:33 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2 1073741824" returned: 0 in 0.879s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:33 devstack sudo[89098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2
Apr 13 20:33:33 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:33 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2" returned: 0 in 0.513s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.478s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-250192991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff6c2a8-eb5d-4696-85da-bb3763b91c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:30Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Creating volume 4ff6c2a8-eb5d-4696-85da-bb3763b91c21 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:33 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d9c34d-b7d9-482b-a69f-bc27a1ab1bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0990b0-073b-47e3-90ca-723401a0a0a2', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:33 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21 1073741824
Apr 13 20:33:33 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5323fb-5c9b-48c3-a5de-5d78246e6c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:33 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume volume-3c0990b0-073b-47e3-90ca-723401a0a0a2 (3c0990b0-073b-47e3-90ca-723401a0a0a2): created successfully
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5323fb-5c9b-48c3-a5de-5d78246e6c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (bd1d5d76-c7ac-435d-ab45-5ef25de69200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:33 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f10ef535-40cb-4989-9911-face0a30efcd tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created volume successfully.
Apr 13 20:33:34 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21 1073741824" returned: 0 in 0.600s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:34 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21
Apr 13 20:33:34 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:34 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21" returned: 0 in 0.518s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.429s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-457267903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd475731-7dd9-4e5e-9099-217c852cf42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a807dd57579459992def677ea8d3951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:30Z,use_quota=True,user_id='d946447c89134fcdbb9b7dda80135cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Creating volume fd475731-7dd9-4e5e-9099-217c852cf42b {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:34 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:34 devstack sudo[89109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b 1073741824
Apr 13 20:33:34 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c931de4a-e1e2-4ca1-9c1f-daadeb0fa53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bcd274-e95e-4258-b06d-08e324b8f4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:34 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21 (4ff6c2a8-eb5d-4696-85da-bb3763b91c21): created successfully
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bcd274-e95e-4258-b06d-08e324b8f4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (f05a932b-7977-468b-8bff-c2368e232d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:34 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-97a84c74-54c8-4cb9-98b7-55aa57952675 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created volume successfully.
Apr 13 20:33:35 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b 1073741824" returned: 0 in 0.672s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:35 devstack sudo[89115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b
Apr 13 20:33:35 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:36 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b" returned: 0 in 0.476s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.863s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] Creating offline snapshot 9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 of volume 7bc7063c-481a-4ded-93cb-f0c8de111c9e {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac4534a-c13c-4b3b-8956-721dbb3d4923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd475731-7dd9-4e5e-9099-217c852cf42b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b46369b-5056-41ff-9fe6-53116266c0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7567bac3-5c7d-4500-b9fa-3eb6019beb47]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:36 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Volume volume-fd475731-7dd9-4e5e-9099-217c852cf42b (fd475731-7dd9-4e5e-9099-217c852cf42b): created successfully
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b46369b-5056-41ff-9fe6-53116266c0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Flow 'volume_create_manager' (e3a923b9-7571-4dc2-a813-8a483ce2fbd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:36 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a3058cb7-7af4-44ac-a05a-83425b1384a1 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created volume successfully.
Apr 13 20:33:36 devstack sudo[89118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e
Apr 13 20:33:36 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:36 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e" returned: 0 in 0.607s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:36 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 1G
Apr 13 20:33:36 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Flow 'volume_create_manager' (343df257-8559-4c19-b852-1b51cb443279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616f96a1-f6da-4393-aa13-95a2a8663f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616f96a1-f6da-4393-aa13-95a2a8663f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1270309861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710c1465ad65424d9b467bf061956bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:37Z,use_quota=True,user_id='25eaabb652074d819f557c346d57e092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b809edb4-3bbd-4e12-9071-29d6c7451062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b809edb4-3bbd-4e12-9071-29d6c7451062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607fe4fc-e3df-4e1e-bdce-9beb7508da91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607fe4fc-e3df-4e1e-bdce-9beb7508da91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf', 'volume_name': 'volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a0280e-8e86-45d7-80f2-aafee2030ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a0280e-8e86-45d7-80f2-aafee2030ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf247875-a86d-4e58-a260-2eeaf9f433fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:36 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Volume 4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf', 'volume_size': 1}
Apr 13 20:33:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-fd475731-7dd9-4e5e-9099-217c852cf42b-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-fd475731-7dd9-4e5e-9099-217c852cf42b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-quobyte-fd475731-7dd9-4e5e-9099-217c852cf42b" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-fd475731-7dd9-4e5e-9099-217c852cf42b" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:37 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 1G" returned: 0 in 0.541s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[e552abf1-42d5-4d5a-9ff9-01de36f6acac]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:37 devstack sudo[89154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525
Apr 13 20:33:37 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:37 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b
Apr 13 20:33:37 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:37 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525" returned: 0 in 0.442s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:37 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 is being set with open permissions: ugo+rw
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:37 devstack sudo[89165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525
Apr 13 20:33:37 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:37 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b" returned: 0 in 0.538s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:37 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b
Apr 13 20:33:37 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:38 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525" returned: 0 in 0.439s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:38 devstack sudo[89171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.info
Apr 13 20:33:38 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:38 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-fd475731-7dd9-4e5e-9099-217c852cf42b" returned: 0 in 0.495s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-fd475731-7dd9-4e5e-9099-217c852cf42b" released by "delete_volume" :: held 1.077s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created reservations ['dd9a647e-69cc-4fb6-b9ab-59a38249edd9', '53059161-1635-4d71-b42c-264335caf6e7', '55b0173d-aeef-4abc-8f98-75fce0f9dbc2', '1c7f5f7d-fec7-427a-a323-07d3f9ae9364'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:38 devstack sudo[89174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:38 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:38 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.info" returned: 0 in 0.454s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:38 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.info is being set with open permissions: ugo+rw
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:38 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.info
Apr 13 20:33:38 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:38 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.393s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:38 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Deleted volume successfully.
Apr 13 20:33:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-cddd0036-2d2b-45f5-80c0-6fadda49c67a tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-fd475731-7dd9-4e5e-9099-217c852cf42b-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:39 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.info" returned: 0 in 0.440s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.998s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.196s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1270309861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710c1465ad65424d9b467bf061956bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:37Z,use_quota=True,user_id='25eaabb652074d819f557c346d57e092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Creating volume 4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:39 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:39 devstack sudo[89181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf 1073741824
Apr 13 20:33:39 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:39 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f1f1b497-8b2b-464c-8190-cb7e847ab119 tempest-SnapshotDependencyTests-102566354 None] Create snapshot completed successfully
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-4ff6c2a8-eb5d-4696-85da-bb3763b91c21-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-4ff6c2a8-eb5d-4696-85da-bb3763b91c21-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-quobyte-4ff6c2a8-eb5d-4696-85da-bb3763b91c21" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-4ff6c2a8-eb5d-4696-85da-bb3763b91c21" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ae461f-3d55-45e1-a579-d437d0405b81]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:39 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21
Apr 13 20:33:39 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:39 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf 1073741824" returned: 0 in 0.557s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:39 devstack sudo[89189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf
Apr 13 20:33:39 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Flow 'volume_create_manager' (fcaead1f-559b-4096-9058-2f50908721a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c8789a-5ec3-4e8a-b037-da86c20eec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c8789a-5ec3-4e8a-b037-da86c20eec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6facbfc0-199c-49eb-a7ca-3d73801753d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87401ce00b9c451dafa0e6a6f609f4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:40Z,use_quota=True,user_id='82b936570b684540b96328fc9989a053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9de4d7c-5579-428d-9ebc-1a8d78decb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9de4d7c-5579-428d-9ebc-1a8d78decb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f2dabd-3d1f-4608-8e60-96af7592413c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f2dabd-3d1f-4608-8e60-96af7592413c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6facbfc0-199c-49eb-a7ca-3d73801753d3', 'volume_name': 'volume-6facbfc0-199c-49eb-a7ca-3d73801753d3', 'volume_size': 1, 'snapshot_id': '9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d7213f-df3d-4448-b60e-95f098326032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d7213f-df3d-4448-b60e-95f098326032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b87c3a-718d-47fd-88c3-fdeaaee88c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:39 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Volume 6facbfc0-199c-49eb-a7ca-3d73801753d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6facbfc0-199c-49eb-a7ca-3d73801753d3', 'volume_size': 1, 'snapshot_id': '9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525'}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:39 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21" returned: 0 in 0.571s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:40 devstack sudo[89195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21
Apr 13 20:33:40 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:40 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf" returned: 0 in 0.442s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.193s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "cinder-quobyte-9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525-6facbfc0-199c-49eb-a7ca-3d73801753d3" by "_create_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf247875-a86d-4e58-a260-2eeaf9f433fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dea27aa-5995-45f9-8afe-0a3f77c0d727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525-6facbfc0-199c-49eb-a7ca-3d73801753d3" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Creating volume 6facbfc0-199c-49eb-a7ca-3d73801753d3 from snapshot 9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 {{(pid=82824) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "cinder-quobyte-6facbfc0-199c-49eb-a7ca-3d73801753d3" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:40 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Volume volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf (4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf): created successfully
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dea27aa-5995-45f9-8afe-0a3f77c0d727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Flow 'volume_create_manager' (343df257-8559-4c19-b852-1b51cb443279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:40 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-efa9f0d0-6983-4783-97a5-bbf09150495d tempest-VolumesTransfersV355Test-1540867477 None] Created volume successfully.
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-6facbfc0-199c-49eb-a7ca-3d73801753d3" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] snapshot: 9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525, volume: 6facbfc0-199c-49eb-a7ca-3d73801753d3,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6125a33a-fdab-4ef7-9f81-638269387a05]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:40 devstack sudo[89197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525
Apr 13 20:33:40 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:40 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4ff6c2a8-eb5d-4696-85da-bb3763b91c21" returned: 0 in 0.437s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-4ff6c2a8-eb5d-4696-85da-bb3763b91c21" released by "delete_volume" :: held 1.048s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created reservations ['d278b31a-545d-4838-a927-fbdbafb66b67', '92ff0860-2507-4fef-87ac-aa1ef7bd6e2b', 'b55156c4-f723-4160-b416-d271555ac16e', '2c603654-f9a4-4aed-a009-2725d4e68ece'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:40 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:40 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:40 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525" returned: 0 in 0.490s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdb9b36-2424-45d5-b240-07e418cd3576]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:40 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e
Apr 13 20:33:40 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:40 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.401s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:40 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Deleted volume successfully.
Apr 13 20:33:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3700f537-40cc-4452-bb7d-e1a7f85044b3 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-4ff6c2a8-eb5d-4696-85da-bb3763b91c21-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:41 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e" returned: 0 in 0.556s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:41 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3 not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:33:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:41 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3
Apr 13 20:33:41 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-86321148-4537-4ca8-bca4-39dd86695bcd tempest-VolumesTransfersV355Test-405459752 None] Transfer volume completed successfully.
Apr 13 20:33:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-3c0990b0-073b-47e3-90ca-723401a0a0a2-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-3c0990b0-073b-47e3-90ca-723401a0a0a2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-quobyte-3c0990b0-073b-47e3-90ca-723401a0a0a2" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-3c0990b0-073b-47e3-90ca-723401a0a0a2" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:41 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1b77d0-0f82-477f-b660-985d8307763d]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:41 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2
Apr 13 20:33:41 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:42 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2" returned: 0 in 1.177s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:42 devstack sudo[89230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2
Apr 13 20:33:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Acquiring lock "cinder-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:42 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Lock "cinder-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Acquiring lock "cinder-quobyte-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Lock "cinder-quobyte-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf" acquired by "delete_volume" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fc1a92-af15-4803-9ee6-4852dce97cf7]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:43 devstack sudo[89234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf
Apr 13 20:33:43 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:43 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3" returned: 0 in 2.509s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[af248f9a-84bc-49ef-8071-1d48a5a7e9c6]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:43 devstack sudo[89236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e
Apr 13 20:33:43 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:43 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c0990b0-073b-47e3-90ca-723401a0a0a2" returned: 0 in 1.075s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-3c0990b0-073b-47e3-90ca-723401a0a0a2" released by "delete_volume" :: held 2.282s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created reservations ['1b890dec-0cf4-4f6d-b8cb-003211b3e558', 'ff26a93b-404a-4078-a58e-29d3fdd21091', '31cbdd3e-2dce-4323-99a9-d6c652e47483', 'd27ca8bf-ac11-45af-8785-393e10754775'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:44 devstack sudo[89243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:44 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:44 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf" returned: 0 in 0.893s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:44 devstack sudo[89245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf
Apr 13 20:33:44 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:44 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e" returned: 0 in 0.708s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3 {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:33:44 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Converted 1024.00 MB image at 407.83 MB/s
Apr 13 20:33:44 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3 is being set with open permissions: ugo+rw
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:44 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3
Apr 13 20:33:44 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:44 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.524s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:44 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Deleted volume successfully.
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d4d84cf3-3bc4-4bf9-90f4-2593255d7c95 tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-3c0990b0-073b-47e3-90ca-723401a0a0a2-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:44 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf" returned: 0 in 0.492s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Lock "cinder-quobyte-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf" released by "delete_volume" :: held 1.434s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Created reservations ['d8c90646-c41e-45c4-a416-9ae4ab1c1232', '04ac5f7d-032f-4ca9-bbaf-6e93915f59db', '374e9ee7-55bf-48fb-a2ba-e5b8eff145c7', '077bac0e-197e-4863-ba68-84be85857957'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:44 devstack sudo[89254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:44 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:44 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3" returned: 0 in 0.430s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-6facbfc0-199c-49eb-a7ca-3d73801753d3" released by "_copy_volume_from_snapshot" :: held 4.761s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525-6facbfc0-199c-49eb-a7ca-3d73801753d3" released by "_create_volume_from_snapshot" :: held 4.791s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.812s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b87c3a-718d-47fd-88c3-fdeaaee88c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6facbfc0-199c-49eb-a7ca-3d73801753d3', 'volume_size': 1, 'snapshot_id': '9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0b205a-59bc-461b-afb4-a7d4967c71d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-f904df50-ac48-4196-87bc-985e65822251-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:44 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Volume volume-6facbfc0-199c-49eb-a7ca-3d73801753d3 (6facbfc0-199c-49eb-a7ca-3d73801753d3): created successfully
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0b205a-59bc-461b-afb4-a7d4967c71d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Flow 'volume_create_manager' (fcaead1f-559b-4096-9058-2f50908721a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-f904df50-ac48-4196-87bc-985e65822251-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:44 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-ae97c157-13a2-4eab-89a0-247b26e614c2 tempest-SnapshotDependencyTests-102566354 None] Created volume successfully.
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-quobyte-f904df50-ac48-4196-87bc-985e65822251" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-f904df50-ac48-4196-87bc-985e65822251" acquired by "delete_volume" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1b41b1-a674-4047-a0c4-65f2ef128794]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:45 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.490s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:45 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Deleted volume successfully.
Apr 13 20:33:45 devstack sudo[89258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251
Apr 13 20:33:45 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d407fdf-c6a0-4315-abb3-d4a30086234b tempest-VolumesTransfersV355Test-1500929289 None] Lock "cinder-4650998e-ff9b-4bf9-a3f0-58e44f9ab7bf-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "cinder-9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "cinder-quobyte-7bc7063c-481a-4ded-93cb-f0c8de111c9e" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-7bc7063c-481a-4ded-93cb-f0c8de111c9e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "cinder-quobyte-9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Deleting offline snapshot 9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 of volume 7bc7063c-481a-4ded-93cb-f0c8de111c9e {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] snapshot_file for this snap is: volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fad2e1-0440-41c4-9050-0bb079d90e7c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:45 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525
Apr 13 20:33:45 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Flow 'volume_create_manager' (af4c2f1b-4220-4076-bde4-c766ba397116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b277e90c-c1b4-402f-83a6-d411783f5939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b277e90c-c1b4-402f-83a6-d411783f5939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1126486920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50484b2-bc43-44e6-8182-a721cf88b575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710c1465ad65424d9b467bf061956bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:46Z,use_quota=True,user_id='25eaabb652074d819f557c346d57e092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9daa892e-a9f3-4701-ba92-66878026b817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9daa892e-a9f3-4701-ba92-66878026b817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3eb63a-e60f-4948-8cd9-25864b4c47ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3eb63a-e60f-4948-8cd9-25864b4c47ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e50484b2-bc43-44e6-8182-a721cf88b575', 'volume_name': 'volume-e50484b2-bc43-44e6-8182-a721cf88b575', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e4e518-db08-49d4-bade-ecd49e20cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e4e518-db08-49d4-bade-ecd49e20cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd19ef8-d486-4851-a2f2-7ae3fc26d9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:45 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Volume e50484b2-bc43-44e6-8182-a721cf88b575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e50484b2-bc43-44e6-8182-a721cf88b575', 'volume_size': 1}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1126486920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50484b2-bc43-44e6-8182-a721cf88b575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710c1465ad65424d9b467bf061956bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:46Z,use_quota=True,user_id='25eaabb652074d819f557c346d57e092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Creating volume e50484b2-bc43-44e6-8182-a721cf88b575 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:45 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:45 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:45 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575 1073741824
Apr 13 20:33:45 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251" returned: 0 in 0.679s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:45 devstack sudo[89270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251
Apr 13 20:33:45 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:45 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525" returned: 0 in 0.606s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1d0839-28ee-4283-92cf-4de890a42f4d]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:45 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e
Apr 13 20:33:45 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:46 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f904df50-ac48-4196-87bc-985e65822251" returned: 0 in 0.461s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-f904df50-ac48-4196-87bc-985e65822251" released by "delete_volume" :: held 1.194s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created reservations ['2d552ca5-8269-4d7b-9414-a80af2035701', '7fb078b0-0ad8-4e52-be34-4cae4d2f148d', 'efdddd3f-51d2-4f55-94a6-a6746b80455d', '7a31dc7b-4030-4b74-81c0-257e96286ed8'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:46 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:46 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:46 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575 1073741824" returned: 0 in 0.656s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:46 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575
Apr 13 20:33:46 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:46 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e" returned: 0 in 0.673s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:46 devstack sudo[89285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525
Apr 13 20:33:46 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Acquiring lock "cinder-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Lock "cinder-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Acquiring lock "cinder-quobyte-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Lock "cinder-quobyte-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238" acquired by "delete_volume" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a1a29c-8cf9-4cfd-a885-410a8ca3d37a]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:46 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238
Apr 13 20:33:46 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:46 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.533s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:46 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Deleted volume successfully.
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59c48264-57a3-401d-8f20-40e7e0ff89be tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-f904df50-ac48-4196-87bc-985e65822251-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:46 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575" returned: 0 in 0.511s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd19ef8-d486-4851-a2f2-7ae3fc26d9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50484b2-bc43-44e6-8182-a721cf88b575', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba795f1-c2a2-4583-a38e-fc955b0231b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:46 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Volume volume-e50484b2-bc43-44e6-8182-a721cf88b575 (e50484b2-bc43-44e6-8182-a721cf88b575): created successfully
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba795f1-c2a2-4583-a38e-fc955b0231b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Flow 'volume_create_manager' (af4c2f1b-4220-4076-bde4-c766ba397116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:46 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8ffad643-cc1d-4667-aceb-d21f6416eb24 tempest-VolumesTransfersV355Test-1540867477 None] Created volume successfully.
Apr 13 20:33:46 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525" returned: 0 in 0.492s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:47 devstack sudo[89294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525
Apr 13 20:33:47 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-3bce8fb8-5c07-4575-be3d-c5cac136edd3-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-3bce8fb8-5c07-4575-be3d-c5cac136edd3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-quobyte-3bce8fb8-5c07-4575-be3d-c5cac136edd3" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-3bce8fb8-5c07-4575-be3d-c5cac136edd3" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb72d024-9276-411e-b5af-ee5bc99fdc60]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:47 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238" returned: 0 in 0.569s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:47 devstack sudo[89300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238
Apr 13 20:33:47 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:47 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3
Apr 13 20:33:47 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:47 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e.9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525" returned: 0 in 0.440s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525" released by "_delete_snapshot" :: held 2.283s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-7bc7063c-481a-4ded-93cb-f0c8de111c9e" released by "delete_snapshot" :: held 2.295s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Created reservations ['2e408032-a3a0-4b61-910d-de5956157d01', 'c8feeb84-b6d4-4b4e-a7cb-e9bb6df3a797', '0f6c23f4-5dad-4b2c-9379-fb0a696b717a', '70852d11-26c5-4fbf-89a4-8befd7c7c638'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:47 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Delete snapshot completed successfully.
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8ca9f911-ca24-44c9-ae01-75ef22642600 tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-9c85e1f8-f7e7-489a-99e1-7ed2bf7a6525-delete_snapshot" released by "delete_snapshot" :: held 2.379s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:47 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238" returned: 0 in 0.452s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Lock "cinder-quobyte-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238" released by "delete_volume" :: held 1.045s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:47 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3" returned: 0 in 0.491s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:47 devstack sudo[89308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3
Apr 13 20:33:47 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Created reservations ['7ad07354-20e4-4cf4-87ed-e2d0a6eaef4c', 'c8f0c2e8-6f24-4f18-a7e9-9086c00b9cd7', '92e6d342-ada2-415d-816d-7e34637daf48', 'b8cbe0e7-d31a-428f-88fc-2d7148dafebb'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:47 devstack sudo[89310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:47 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Acquiring lock "cinder-e50484b2-bc43-44e6-8182-a721cf88b575-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Lock "cinder-e50484b2-bc43-44e6-8182-a721cf88b575-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Acquiring lock "cinder-quobyte-e50484b2-bc43-44e6-8182-a721cf88b575" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Lock "cinder-quobyte-e50484b2-bc43-44e6-8182-a721cf88b575" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe59a527-3681-4002-945a-452bce9aec75]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:48 devstack sudo[89312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575
Apr 13 20:33:48 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:48 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3bce8fb8-5c07-4575-be3d-c5cac136edd3" returned: 0 in 0.434s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-3bce8fb8-5c07-4575-be3d-c5cac136edd3" released by "delete_volume" :: held 0.948s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created reservations ['edbf47d0-ba40-4aec-9326-e240717de350', '72ef3ced-e51b-47e3-af77-4f41361468ad', '644e4513-4060-4288-b877-fdfd7d573a15', '188183db-e21e-404f-9b0c-22d9351e726c'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:48 devstack sudo[89316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:48 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:48 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.473s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:48 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Deleted volume successfully.
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5a0d25bd-3c1b-4da5-af36-3ffd9a5fed38 tempest-VolumesNegativeTest-383787104 None] Lock "cinder-e50f1cdc-8313-4b04-a8ff-11c2c5ab4238-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "cinder-7bc7063c-481a-4ded-93cb-f0c8de111c9e-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "cinder-quobyte-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-7bc7063c-481a-4ded-93cb-f0c8de111c9e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad2a10f-e6c7-4281-a366-f517ff59fea1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "cinder-quobyte-7bc7063c-481a-4ded-93cb-f0c8de111c9e" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-7bc7063c-481a-4ded-93cb-f0c8de111c9e" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a12cf4d-cf7a-4049-85c3-2aed919bc09d]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:48 devstack sudo[89318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f
Apr 13 20:33:48 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:48 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e
Apr 13 20:33:48 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:48 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575" returned: 0 in 0.545s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:48 devstack sudo[89325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575
Apr 13 20:33:48 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:48 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.474s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:48 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Deleted volume successfully.
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-99c73181-910e-44f6-96e9-0aabb9fdf7fb tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-3bce8fb8-5c07-4575-be3d-c5cac136edd3-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:48 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f" returned: 0 in 0.530s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:48 devstack sudo[89334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f
Apr 13 20:33:48 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:48 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e" returned: 0 in 0.520s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:48 devstack sudo[89337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e
Apr 13 20:33:48 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:49 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e50484b2-bc43-44e6-8182-a721cf88b575" returned: 0 in 0.479s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Lock "cinder-quobyte-e50484b2-bc43-44e6-8182-a721cf88b575" released by "delete_volume" :: held 1.055s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Created reservations ['db798861-afc3-46d7-82ee-1ba76021449f', '369a9395-d638-4e80-9690-f48a896b0466', 'c4a4a0c1-4d71-4eaa-8b1d-f1dd8b77ef87', '48438f65-bb38-4afa-9e67-6048095c3dad'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:49 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:49 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:49 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-quobyte-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f" released by "delete_volume" :: held 1.042s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Created reservations ['31c66b53-4ae9-40da-b7d8-916b76a874aa', 'c0dd93c1-c47b-4020-bfc8-08f32ebbac90', '3e36f0d8-682a-4773-b0df-a928da6db99b', 'e94ff901-18e8-498e-b73f-7ac66796edad'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:49 devstack sudo[89345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:49 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:49 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7bc7063c-481a-4ded-93cb-f0c8de111c9e" returned: 0 in 0.601s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-7bc7063c-481a-4ded-93cb-f0c8de111c9e" released by "delete_volume" :: held 1.149s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:49 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.485s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Created reservations ['fd91d256-c007-44f4-9909-677e51b33570', '6badc55d-c6d4-468c-bb24-00aeb9046d7b', 'fd0d86cc-6353-4004-9df1-b9d6ac0edc32', '2e3c3e1a-b00a-48b7-904c-77264294613b'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:49 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Deleted volume successfully.
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-90e74688-92f4-4a89-8412-849a1ff5f37b tempest-VolumesTransfersV355Test-1500929289 None] Lock "cinder-e50484b2-bc43-44e6-8182-a721cf88b575-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:49 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:49 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:49 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.489s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:49 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:50 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Deleted volume successfully.
Apr 13 20:33:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1fb8433b-f5d6-4bac-813b-14e18b235a6e tempest-CreateVolumesFromSourceVolumeTest-1168019837 None] Lock "cinder-bed0937d-1b13-4cde-9bd4-1d5a2e38ac7f-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:50 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.466s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:50 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:50 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Deleted volume successfully.
Apr 13 20:33:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2978ea0b-efb6-4618-829a-264e219ba69e tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-7bc7063c-481a-4ded-93cb-f0c8de111c9e-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "cinder-6facbfc0-199c-49eb-a7ca-3d73801753d3-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-6facbfc0-199c-49eb-a7ca-3d73801753d3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "cinder-quobyte-6facbfc0-199c-49eb-a7ca-3d73801753d3" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:33:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-6facbfc0-199c-49eb-a7ca-3d73801753d3" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:33:50 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9b6e00-23ae-442b-ba3b-918ceb4b496b]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:33:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:50 devstack sudo[89351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3
Apr 13 20:33:50 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:51 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3" returned: 0 in 0.537s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:51 devstack sudo[89356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3
Apr 13 20:33:51 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:51 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-6facbfc0-199c-49eb-a7ca-3d73801753d3" returned: 0 in 0.471s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-quobyte-6facbfc0-199c-49eb-a7ca-3d73801753d3" released by "delete_volume" :: held 1.032s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:51 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Created reservations ['a6403f2d-b1a8-45da-8360-daec6c90bb28', '6712e594-997e-4b3f-bc79-f1384d1254c6', 'bf1ac753-6c25-42a3-9370-06a86660de27', '2a4d4365-8b70-4090-8452-157d925d52ef'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:33:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:51 devstack sudo[89359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:51 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:52 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.570s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:52 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:52 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Deleted volume successfully.
Apr 13 20:33:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-bab2eb84-8cbf-45a4-b05f-29d609d630ec tempest-SnapshotDependencyTests-102566354 None] Lock "cinder-6facbfc0-199c-49eb-a7ca-3d73801753d3-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:33:57 devstack cinder-volume[82824]: DEBUG oslo_service.periodic_task [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82824) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:33:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:57 devstack sudo[89363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:33:57 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:58 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.517s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Flow 'volume_create_manager' (6f3c7ca2-12a3-4114-a652-b17ca2d6fbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa819e45-01f5-4b67-a4cf-ea6f60fe7429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa819e45-01f5-4b67-a4cf-ea6f60fe7429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-912809437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4f818e-8446-4ec4-a9f4-edf66928afe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a1bde2a3e24b5fad860e1ac55d5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:58Z,use_quota=True,user_id='ae77c165e63a4e0d906c3876a50c86cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe5007b-3f58-46af-bc7a-10f8ec65a2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe5007b-3f58-46af-bc7a-10f8ec65a2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e794960-a29d-40ae-9e46-3c8d3d853400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e794960-a29d-40ae-9e46-3c8d3d853400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f4f818e-8446-4ec4-a9f4-edf66928afe5', 'volume_name': 'volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b608377d-1585-4854-a115-00db238d78a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b608377d-1585-4854-a115-00db238d78a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad07008a-25ac-4841-a92f-25d6c1fc798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:58 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume 3f4f818e-8446-4ec4-a9f4-edf66928afe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5', 'volume_size': 1}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-912809437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4f818e-8446-4ec4-a9f4-edf66928afe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a1bde2a3e24b5fad860e1ac55d5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:33:58Z,use_quota=True,user_id='ae77c165e63a4e0d906c3876a50c86cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Creating volume 3f4f818e-8446-4ec4-a9f4-edf66928afe5 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:33:58 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:33:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:58 devstack sudo[89367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 1073741824
Apr 13 20:33:58 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:59 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 1073741824" returned: 0 in 0.553s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:33:59 devstack sudo[89372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5
Apr 13 20:33:59 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:33:59 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root
Apr 13 20:33:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5" returned: 0 in 0.489s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:33:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:33:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:33:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad07008a-25ac-4841-a92f-25d6c1fc798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac90f565-8254-484c-bc8f-7cda2c092e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:33:59 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 (3f4f818e-8446-4ec4-a9f4-edf66928afe5): created successfully
Apr 13 20:33:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac90f565-8254-484c-bc8f-7cda2c092e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:33:59 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Flow 'volume_create_manager' (6f3c7ca2-12a3-4114-a652-b17ca2d6fbfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:33:59 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-7b06e0d3-6339-43d3-8319-a479686e11b4 tempest-VolumesSnapshotTestJSON-1007801857 None] Created volume successfully.
Apr 13 20:34:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] Creating offline snapshot bfe78d0d-07d1-46db-bbff-4a2401f7a3da of volume 3f4f818e-8446-4ec4-a9f4-edf66928afe5 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:34:00 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2781ee-10da-4d46-952b-0daf57bef467]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:00 devstack sudo[89377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5
Apr 13 20:34:00 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:01 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5" returned: 0 in 0.549s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:01 devstack sudo[89382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da 1G
Apr 13 20:34:01 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:02 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da 1G" returned: 0 in 0.630s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:02 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da
Apr 13 20:34:02 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:02 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da" returned: 0 in 0.602s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:02 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da is being set with open permissions: ugo+rw
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:02 devstack sudo[89392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da
Apr 13 20:34:02 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Flow 'volume_create_manager' (56fb7304-d153-4400-819c-482e38593b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a00b137-9235-4692-b8f2-07611ff9bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a00b137-9235-4692-b8f2-07611ff9bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-505501062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f989b2-6b79-41fb-9afa-1b899c900234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27868345b3841b58789d8fb1a32cd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:34:03Z,use_quota=True,user_id='cde04855c7964492b71d21f0a95df1e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317f43e4-bd8b-470b-bfb2-e76f1bfeb87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317f43e4-bd8b-470b-bfb2-e76f1bfeb87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9057481d-f60d-4889-8d7d-7491ff6a3a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9057481d-f60d-4889-8d7d-7491ff6a3a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f989b2-6b79-41fb-9afa-1b899c900234', 'volume_name': 'volume-e3f989b2-6b79-41fb-9afa-1b899c900234', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcea5091-223f-40b3-8bcf-5b954bb1215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcea5091-223f-40b3-8bcf-5b954bb1215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533b84ce-6424-42d9-9d14-7907bb35d271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:02 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Volume e3f989b2-6b79-41fb-9afa-1b899c900234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f989b2-6b79-41fb-9afa-1b899c900234', 'volume_size': 1}
Apr 13 20:34:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:03 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da" returned: 0 in 0.464s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:03 devstack sudo[89395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.info
Apr 13 20:34:03 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:03 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.info" returned: 0 in 0.509s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:03 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.info is being set with open permissions: ugo+rw
Apr 13 20:34:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:03 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.info
Apr 13 20:34:03 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:04 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.info" returned: 0 in 0.493s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.333s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.192s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-505501062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f989b2-6b79-41fb-9afa-1b899c900234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27868345b3841b58789d8fb1a32cd40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:34:03Z,use_quota=True,user_id='cde04855c7964492b71d21f0a95df1e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Creating volume e3f989b2-6b79-41fb-9afa-1b899c900234 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:34:04 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:04 devstack sudo[89402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 1073741824
Apr 13 20:34:04 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:04 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-cf1cc1ff-accf-4dcc-93d7-ee095b5c68b7 tempest-VolumesSnapshotTestJSON-1007801857 None] Create snapshot completed successfully
Apr 13 20:34:04 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 1073741824" returned: 0 in 0.568s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:04 devstack sudo[89407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234
Apr 13 20:34:04 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-bfe78d0d-07d1-46db-bbff-4a2401f7a3da-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-bfe78d0d-07d1-46db-bbff-4a2401f7a3da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-3f4f818e-8446-4ec4-a9f4-edf66928afe5" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-3f4f818e-8446-4ec4-a9f4-edf66928afe5" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-bfe78d0d-07d1-46db-bbff-4a2401f7a3da" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-bfe78d0d-07d1-46db-bbff-4a2401f7a3da" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Deleting offline snapshot bfe78d0d-07d1-46db-bbff-4a2401f7a3da of volume 3f4f818e-8446-4ec4-a9f4-edf66928afe5 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] snapshot_file for this snap is: volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[77625edc-a293-4a86-a7fb-f0e8f2a52484]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:05 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234" returned: 0 in 0.452s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533b84ce-6424-42d9-9d14-7907bb35d271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f989b2-6b79-41fb-9afa-1b899c900234', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90558bf-07ea-4259-ab75-6b139661680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:05 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Volume volume-e3f989b2-6b79-41fb-9afa-1b899c900234 (e3f989b2-6b79-41fb-9afa-1b899c900234): created successfully
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90558bf-07ea-4259-ab75-6b139661680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Flow 'volume_create_manager' (56fb7304-d153-4400-819c-482e38593b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:05 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-ee854537-0b0b-44fc-82f6-12dc8aaa53a3 tempest-VolumesActionsTest-1113337949 None] Created volume successfully.
Apr 13 20:34:05 devstack sudo[89410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da
Apr 13 20:34:05 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:05 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da" returned: 0 in 0.480s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[433908f2-40ba-4f8f-9e25-9c5159afafa9]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:05 devstack sudo[89415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5
Apr 13 20:34:05 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:06 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5" returned: 0 in 0.497s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:06 devstack sudo[89420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da
Apr 13 20:34:06 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:06 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da" returned: 0 in 0.494s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:06 devstack sudo[89428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da
Apr 13 20:34:06 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:07 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5.bfe78d0d-07d1-46db-bbff-4a2401f7a3da" returned: 0 in 0.414s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-bfe78d0d-07d1-46db-bbff-4a2401f7a3da" released by "_delete_snapshot" :: held 1.936s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-3f4f818e-8446-4ec4-a9f4-edf66928afe5" released by "delete_snapshot" :: held 1.947s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Created reservations ['7db09950-559a-4f68-8a1a-a2d778096d99', '50ec64f4-627a-443c-8a9d-8022b8b75731', '69220f9e-2942-482a-9ebb-105ee3ec83ff', '5de40416-c7d6-49be-9f0c-4fa2c58da924'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:34:07 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Delete snapshot completed successfully.
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa811b8f-3037-4c33-bfc3-51e12520fdfc tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-bfe78d0d-07d1-46db-bbff-4a2401f7a3da-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Flow 'volume_create_manager' (49a86b84-6fa5-4e56-b8cc-5f753f70545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096e2c02-1c4e-4ad5-a892-669738f6d3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096e2c02-1c4e-4ad5-a892-669738f6d3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1245681372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05384ab-b8e2-46bd-9c66-4275a18c814c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a1bde2a3e24b5fad860e1ac55d5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:34:08Z,use_quota=True,user_id='ae77c165e63a4e0d906c3876a50c86cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20b3d92-0548-447c-9344-0cc0128395b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20b3d92-0548-447c-9344-0cc0128395b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c948d3-517b-4ceb-a607-2dfb9a517566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c948d3-517b-4ceb-a607-2dfb9a517566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e05384ab-b8e2-46bd-9c66-4275a18c814c', 'volume_name': 'volume-e05384ab-b8e2-46bd-9c66-4275a18c814c', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d393b3bd-9210-4a29-bf00-0c2cd410c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d393b3bd-9210-4a29-bf00-0c2cd410c404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d235d369-91c6-4326-b037-85b32fcb65a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:07 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume e05384ab-b8e2-46bd-9c66-4275a18c814c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e05384ab-b8e2-46bd-9c66-4275a18c814c', 'volume_size': 1}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1245681372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05384ab-b8e2-46bd-9c66-4275a18c814c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a1bde2a3e24b5fad860e1ac55d5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:34:08Z,use_quota=True,user_id='ae77c165e63a4e0d906c3876a50c86cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Creating volume e05384ab-b8e2-46bd-9c66-4275a18c814c {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:34:07 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:34:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:07 devstack sudo[89432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c 1073741824
Apr 13 20:34:07 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:08 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c 1073741824" returned: 0 in 0.497s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:08 devstack sudo[89437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c
Apr 13 20:34:08 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:08 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c" returned: 0 in 0.423s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:34:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d235d369-91c6-4326-b037-85b32fcb65a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e05384ab-b8e2-46bd-9c66-4275a18c814c', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8a13ac-8428-4a48-b391-f4a0e634da9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:08 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume volume-e05384ab-b8e2-46bd-9c66-4275a18c814c (e05384ab-b8e2-46bd-9c66-4275a18c814c): created successfully
Apr 13 20:34:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8a13ac-8428-4a48-b391-f4a0e634da9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Flow 'volume_create_manager' (49a86b84-6fa5-4e56-b8cc-5f753f70545c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:08 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-87b7fff0-0e79-4818-a3ab-5f4530c9a3b1 tempest-VolumesSnapshotTestJSON-1007801857 None] Created volume successfully.
Apr 13 20:34:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] Creating offline snapshot a0f0eb21-390a-4c85-a67d-2c280f54a038 of volume e05384ab-b8e2-46bd-9c66-4275a18c814c {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:34:09 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[744b25d5-c39d-46ba-b45e-f61927f752f9]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:09 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c
Apr 13 20:34:09 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:10 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c" returned: 0 in 0.522s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:10 devstack sudo[89446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038 1G
Apr 13 20:34:10 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:10 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038 1G" returned: 0 in 0.470s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e05384ab-b8e2-46bd-9c66-4275a18c814c -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:10 devstack sudo[89457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e05384ab-b8e2-46bd-9c66-4275a18c814c -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038
Apr 13 20:34:10 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:11 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e05384ab-b8e2-46bd-9c66-4275a18c814c -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038" returned: 0 in 0.444s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:11 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038 is being set with open permissions: ugo+rw
Apr 13 20:34:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:11 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038
Apr 13 20:34:11 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:11 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038" returned: 0 in 0.463s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:11 devstack sudo[89465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.info
Apr 13 20:34:11 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:12 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.info" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:12 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.info is being set with open permissions: ugo+rw
Apr 13 20:34:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:12 devstack sudo[89468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.info
Apr 13 20:34:12 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:12 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.info" returned: 0 in 0.421s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.873s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:12 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-9098bbe2-c740-45db-b908-5aa8b30e7874 tempest-VolumesSnapshotTestJSON-1007801857 None] Create snapshot completed successfully
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Flow 'volume_create_manager' (8c07fcd1-443a-4b9f-9545-322570f1925f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fed8f32-0692-48b9-9dcb-150684064bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fed8f32-0692-48b9-9dcb-150684064bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-405708634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d488553-1faa-47ed-94a2-4d1c269b287f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a1bde2a3e24b5fad860e1ac55d5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:34:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a0f0eb21-390a-4c85-a67d-2c280f54a038,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:34:13Z,use_quota=True,user_id='ae77c165e63a4e0d906c3876a50c86cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4818d667-8332-4934-bccc-6810b782d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4818d667-8332-4934-bccc-6810b782d074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb38687-4bfb-4709-8c15-3c57064b1ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb38687-4bfb-4709-8c15-3c57064b1ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d488553-1faa-47ed-94a2-4d1c269b287f', 'volume_name': 'volume-0d488553-1faa-47ed-94a2-4d1c269b287f', 'volume_size': 2, 'snapshot_id': 'a0f0eb21-390a-4c85-a67d-2c280f54a038'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d19ce50-3e24-4f82-8db2-3029475c8fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d19ce50-3e24-4f82-8db2-3029475c8fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2952ed47-553a-40d6-a691-720eb49bbba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:13 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume 0d488553-1faa-47ed-94a2-4d1c269b287f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d488553-1faa-47ed-94a2-4d1c269b287f', 'volume_size': 2, 'snapshot_id': 'a0f0eb21-390a-4c85-a67d-2c280f54a038'}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-a0f0eb21-390a-4c85-a67d-2c280f54a038-0d488553-1faa-47ed-94a2-4d1c269b287f" by "_create_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-a0f0eb21-390a-4c85-a67d-2c280f54a038-0d488553-1faa-47ed-94a2-4d1c269b287f" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Creating volume 0d488553-1faa-47ed-94a2-4d1c269b287f from snapshot a0f0eb21-390a-4c85-a67d-2c280f54a038 {{(pid=82824) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-0d488553-1faa-47ed-94a2-4d1c269b287f" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-0d488553-1faa-47ed-94a2-4d1c269b287f" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] snapshot: a0f0eb21-390a-4c85-a67d-2c280f54a038, volume: 0d488553-1faa-47ed-94a2-4d1c269b287f,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1277ef40-5f35-4f4e-b59d-60cd5310a110]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:13 devstack sudo[89485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038
Apr 13 20:34:13 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:13 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038" returned: 0 in 0.498s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e05384ab-b8e2-46bd-9c66-4275a18c814c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c57712f-82b6-4c90-8d07-ae1a800bd4ba]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:13 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c
Apr 13 20:34:13 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:14 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c" returned: 0 in 0.524s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:14 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:34:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:14 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f
Apr 13 20:34:14 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:16 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f" returned: 0 in 2.163s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:16 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14a0a92-c868-42cf-961e-d4cf2712232d]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:16 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c
Apr 13 20:34:16 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:17 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c" returned: 0 in 0.647s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:34:17 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Converted 1024.00 MB image at 473.07 MB/s
Apr 13 20:34:17 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f is being set with open permissions: ugo+rw
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:17 devstack sudo[89579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f
Apr 13 20:34:17 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:17 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f" returned: 0 in 0.517s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-0d488553-1faa-47ed-94a2-4d1c269b287f" released by "_copy_volume_from_snapshot" :: held 4.405s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-a0f0eb21-390a-4c85-a67d-2c280f54a038-0d488553-1faa-47ed-94a2-4d1c269b287f" released by "_create_volume_from_snapshot" :: held 4.422s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.430s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=161,cinder:UPDATE=213,cinder:INSERT=42,cinder:DELETE=17 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=148,cinder:UPDATE=205,cinder:DELETE=21,cinder:INSERT=57 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2952ed47-553a-40d6-a691-720eb49bbba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d488553-1faa-47ed-94a2-4d1c269b287f', 'volume_size': 2, 'snapshot_id': 'a0f0eb21-390a-4c85-a67d-2c280f54a038'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892dd10f-8f70-4a60-b229-2083d22d0ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:17 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume volume-0d488553-1faa-47ed-94a2-4d1c269b287f (0d488553-1faa-47ed-94a2-4d1c269b287f): created successfully
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892dd10f-8f70-4a60-b229-2083d22d0ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Flow 'volume_create_manager' (8c07fcd1-443a-4b9f-9545-322570f1925f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:17 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3ffc41e0-4d26-4ce2-a935-a6f980355544 tempest-VolumesSnapshotTestJSON-1007801857 None] Created volume successfully.
Apr 13 20:34:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-0d488553-1faa-47ed-94a2-4d1c269b287f-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-0d488553-1faa-47ed-94a2-4d1c269b287f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-0d488553-1faa-47ed-94a2-4d1c269b287f" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-0d488553-1faa-47ed-94a2-4d1c269b287f" acquired by "delete_volume" :: waited 0.017s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:18 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d90f86-3286-44dd-a0b9-ab83efb3b826]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:18 devstack sudo[89584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f
Apr 13 20:34:18 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:19 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f" returned: 0 in 0.502s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:19 devstack sudo[89589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f
Apr 13 20:34:19 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:19 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0d488553-1faa-47ed-94a2-4d1c269b287f" returned: 0 in 0.404s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-0d488553-1faa-47ed-94a2-4d1c269b287f" released by "delete_volume" :: held 0.931s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Created reservations ['e2fc2cf6-50c7-4802-a855-51cb8d82b76f', '64f9ab77-bc69-4faa-8675-602896edc026', 'ba8ec1d1-6f74-49db-8114-829d81d6d271', '520cc1d5-57fe-4717-a9ba-272f85f9249e'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:19 devstack sudo[89593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:34:19 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-a0f0eb21-390a-4c85-a67d-2c280f54a038-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-a0f0eb21-390a-4c85-a67d-2c280f54a038-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-e05384ab-b8e2-46bd-9c66-4275a18c814c" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-e05384ab-b8e2-46bd-9c66-4275a18c814c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-a0f0eb21-390a-4c85-a67d-2c280f54a038" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-a0f0eb21-390a-4c85-a67d-2c280f54a038" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Deleting offline snapshot a0f0eb21-390a-4c85-a67d-2c280f54a038 of volume e05384ab-b8e2-46bd-9c66-4275a18c814c {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] snapshot_file for this snap is: volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[2608ed75-4c7a-4162-a5a4-75da9ea5e2fe]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f1bd2bc6-c7dc-46cf-9097-7414213d006b tempest-VolumesActionsTest-1113337949 None] Acquiring lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234" by "attach_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f1bd2bc6-c7dc-46cf-9097-7414213d006b tempest-VolumesActionsTest-1113337949 None] Lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234" acquired by "attach_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:19 devstack sudo[89595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038
Apr 13 20:34:19 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:19 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f1bd2bc6-c7dc-46cf-9097-7414213d006b tempest-VolumesActionsTest-1113337949 None] Attaching volume e3f989b2-6b79-41fb-9afa-1b899c900234 to instance 49f6e864-a43a-43a7-a541-21f8f972c97a at mountpoint /dev/vdb on host None.
Apr 13 20:34:19 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f1bd2bc6-c7dc-46cf-9097-7414213d006b tempest-VolumesActionsTest-1113337949 None] Attach volume completed successfully.
Apr 13 20:34:19 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f1bd2bc6-c7dc-46cf-9097-7414213d006b tempest-VolumesActionsTest-1113337949 None] Lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234" released by "attach_volume" :: held 0.067s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:20 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.515s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:34:20 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Deleted volume successfully.
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33071881-f527-4861-959d-41fde142ee2d tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-0d488553-1faa-47ed-94a2-4d1c269b287f-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:20 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038" returned: 0 in 0.495s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e05384ab-b8e2-46bd-9c66-4275a18c814c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2d35ef-0a80-4aa5-b5a7-2cf0d2247546]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:20 devstack sudo[89601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c
Apr 13 20:34:20 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae243c91-7af1-4b73-8243-cfd858b713a2 tempest-VolumesActionsTest-1113337949 None] Acquiring lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234-detach_volume" by "detach_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae243c91-7af1-4b73-8243-cfd858b713a2 tempest-VolumesActionsTest-1113337949 None] Lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:20 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-ae243c91-7af1-4b73-8243-cfd858b713a2 tempest-VolumesActionsTest-1113337949 None] Detaching volume e3f989b2-6b79-41fb-9afa-1b899c900234 from instance 49f6e864-a43a-43a7-a541-21f8f972c97a.
Apr 13 20:34:20 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-ae243c91-7af1-4b73-8243-cfd858b713a2 tempest-VolumesActionsTest-1113337949 None] Detach volume completed successfully.
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-ae243c91-7af1-4b73-8243-cfd858b713a2 tempest-VolumesActionsTest-1113337949 None] Lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:20 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c" returned: 0 in 0.496s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:20 devstack sudo[89606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038
Apr 13 20:34:20 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:21 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038" returned: 0 in 0.511s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:21 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038
Apr 13 20:34:21 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:21 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c.a0f0eb21-390a-4c85-a67d-2c280f54a038" returned: 0 in 0.435s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:21 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-a0f0eb21-390a-4c85-a67d-2c280f54a038" released by "_delete_snapshot" :: held 1.992s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:21 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-e05384ab-b8e2-46bd-9c66-4275a18c814c" released by "delete_snapshot" :: held 2.004s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:21 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Created reservations ['2ea65c9b-150b-401e-a7cf-d65cea42cbff', '1dd5aebd-c5fe-4f06-aa8d-2c7a995d359f', '80e43c5d-ad74-40b8-9244-f07877fdecb1', 'd5b71caa-1d2f-4cf8-b3c1-fbb473e14c31'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:34:21 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Delete snapshot completed successfully.
Apr 13 20:34:21 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b3411f8d-5959-4c87-a91b-599e79e58fc0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-a0f0eb21-390a-4c85-a67d-2c280f54a038-delete_snapshot" released by "delete_snapshot" :: held 2.101s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-e05384ab-b8e2-46bd-9c66-4275a18c814c-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-e05384ab-b8e2-46bd-9c66-4275a18c814c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-e05384ab-b8e2-46bd-9c66-4275a18c814c" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-e05384ab-b8e2-46bd-9c66-4275a18c814c" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:23 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d35511e-376f-445c-a030-e7f71c20370c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:23 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c
Apr 13 20:34:23 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:23 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c" returned: 0 in 0.471s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:23 devstack sudo[89650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c
Apr 13 20:34:23 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:23 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e05384ab-b8e2-46bd-9c66-4275a18c814c" returned: 0 in 0.452s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-e05384ab-b8e2-46bd-9c66-4275a18c814c" released by "delete_volume" :: held 0.950s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:23 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Created reservations ['a4265e22-6a01-4bc1-baa4-68fc881f1c34', 'a469b7c8-fb97-4e7c-973f-d038d853358e', '4ff826fd-662c-4ab6-85a7-0470f280763e', 'e4d2f020-4f6d-4efd-86a6-035cbf124ebf'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:24 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:34:24 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Flow 'volume_create_manager' (e909afa4-129f-43e1-8962-47302e73880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124178bc-18e8-4be4-8228-5f550a772fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124178bc-18e8-4be4-8228-5f550a772fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1587436792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d621c90-1575-41ca-b374-087778930987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a1bde2a3e24b5fad860e1ac55d5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:34:24Z,use_quota=True,user_id='ae77c165e63a4e0d906c3876a50c86cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e69e74-8eec-44d0-832e-ac2504693975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e69e74-8eec-44d0-832e-ac2504693975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac6a661-4390-445d-b666-3a88df24b1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac6a661-4390-445d-b666-3a88df24b1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d621c90-1575-41ca-b374-087778930987', 'volume_name': 'volume-3d621c90-1575-41ca-b374-087778930987', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea248f9-a5d9-408c-83c3-b5474708a04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea248f9-a5d9-408c-83c3-b5474708a04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8767fd3c-2891-458f-a2c1-525b88a8c8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:24 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Volume 3d621c90-1575-41ca-b374-087778930987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d621c90-1575-41ca-b374-087778930987', 'volume_size': 1}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1587436792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d621c90-1575-41ca-b374-087778930987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a1bde2a3e24b5fad860e1ac55d5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:34:24Z,use_quota=True,user_id='ae77c165e63a4e0d906c3876a50c86cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Creating volume 3d621c90-1575-41ca-b374-087778930987 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:34:24 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:24 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 1073741824
Apr 13 20:34:24 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:24 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.450s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:34:24 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Deleted volume successfully.
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-38126164-4be8-4ba7-8e04-ada3dc17ee92 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-e05384ab-b8e2-46bd-9c66-4275a18c814c-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:24 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 1073741824" returned: 0 in 0.500s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:24 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987
Apr 13 20:34:24 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:25 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987" returned: 0 in 0.422s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:25 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:34:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8767fd3c-2891-458f-a2c1-525b88a8c8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d621c90-1575-41ca-b374-087778930987', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85039147-bf36-4126-86c6-69801accef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:25 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Volume volume-3d621c90-1575-41ca-b374-087778930987 (3d621c90-1575-41ca-b374-087778930987): created successfully
Apr 13 20:34:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85039147-bf36-4126-86c6-69801accef02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Flow 'volume_create_manager' (e909afa4-129f-43e1-8962-47302e73880c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:25 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d20b4c3e-6d1d-478f-82ad-07aa476f16df tempest-VolumesSnapshotTestJSON-1007801857 None] Created volume successfully.
Apr 13 20:34:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:26 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] Creating offline snapshot dac1bb09-ee51-4f51-a58b-a55c80281f19 of volume 3d621c90-1575-41ca-b374-087778930987 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:34:26 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c68363-4e8b-44bc-b97c-b268d0fa05f9]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:26 devstack sudo[89665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987
Apr 13 20:34:26 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:27 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987" returned: 0 in 0.521s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:27 devstack sudo[89670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19 1G
Apr 13 20:34:27 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:27 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19 1G" returned: 0 in 0.524s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d621c90-1575-41ca-b374-087778930987 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:27 devstack sudo[89678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d621c90-1575-41ca-b374-087778930987 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19
Apr 13 20:34:27 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:28 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d621c90-1575-41ca-b374-087778930987 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19" returned: 0 in 0.427s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:28 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19 is being set with open permissions: ugo+rw
Apr 13 20:34:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:28 devstack sudo[89684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19
Apr 13 20:34:28 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:28 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19" returned: 0 in 0.389s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:28 devstack sudo[89688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.info
Apr 13 20:34:28 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:28 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.info" returned: 0 in 0.413s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:28 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.info is being set with open permissions: ugo+rw
Apr 13 20:34:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:28 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.info
Apr 13 20:34:28 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:29 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.info" returned: 0 in 0.410s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:29 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1cbcd4ab-5fca-4d78-8a59-a0bdfddead42 tempest-VolumesSnapshotTestJSON-1007801857 None] Create snapshot completed successfully
Apr 13 20:34:29 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:34:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Flow 'volume_create_manager' (8f6872d1-582e-400c-b75e-78d950656933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d752c0-575b-4c33-8ec9-37fd9bb8535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d752c0-575b-4c33-8ec9-37fd9bb8535e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1670545866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69829b21-dd10-44e5-9ee8-55ab0fb9cd12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a1bde2a3e24b5fad860e1ac55d5fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dac1bb09-ee51-4f51-a58b-a55c80281f19,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:34:30Z,use_quota=True,user_id='ae77c165e63a4e0d906c3876a50c86cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca10d0b-29c4-4d5d-b6cf-087e3a9cd6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca10d0b-29c4-4d5d-b6cf-087e3a9cd6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45301ce-ad81-4dd8-9685-5be66421bffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45301ce-ad81-4dd8-9685-5be66421bffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69829b21-dd10-44e5-9ee8-55ab0fb9cd12', 'volume_name': 'volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12', 'volume_size': 1, 'snapshot_id': 'dac1bb09-ee51-4f51-a58b-a55c80281f19'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf878fbb-0884-4a46-8c84-6410fd2c7a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf878fbb-0884-4a46-8c84-6410fd2c7a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f244296-1cdc-4710-9c2d-4735e8d33c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:30 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume 69829b21-dd10-44e5-9ee8-55ab0fb9cd12: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12', 'volume_size': 1, 'snapshot_id': 'dac1bb09-ee51-4f51-a58b-a55c80281f19'}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-dac1bb09-ee51-4f51-a58b-a55c80281f19-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" by "_create_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-dac1bb09-ee51-4f51-a58b-a55c80281f19-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Creating volume 69829b21-dd10-44e5-9ee8-55ab0fb9cd12 from snapshot dac1bb09-ee51-4f51-a58b-a55c80281f19 {{(pid=82824) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] snapshot: dac1bb09-ee51-4f51-a58b-a55c80281f19, volume: 69829b21-dd10-44e5-9ee8-55ab0fb9cd12,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a929a4e-b5ee-4240-815a-81603d92c3b2]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:30 devstack sudo[89695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19
Apr 13 20:34:30 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:30 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19" returned: 0 in 0.478s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d621c90-1575-41ca-b374-087778930987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[8101173e-c3af-473c-ae02-34b07da8f3eb]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:30 devstack sudo[89700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987
Apr 13 20:34:30 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:31 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987" returned: 0 in 0.487s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:31 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12 not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:34:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:31 devstack sudo[89705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12
Apr 13 20:34:31 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:33 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" returned: 0 in 2.033s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:33 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0c9137-76f2-4754-9c29-d030a16cd142]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:33 devstack sudo[89717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987
Apr 13 20:34:33 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:33 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987" returned: 0 in 0.694s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:33 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12 {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:34:33 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Converted 1024.00 MB image at 503.41 MB/s
Apr 13 20:34:33 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12 is being set with open permissions: ugo+rw
Apr 13 20:34:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:33 devstack sudo[89724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12
Apr 13 20:34:33 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:34 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" returned: 0 in 0.450s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" released by "_copy_volume_from_snapshot" :: held 4.196s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-dac1bb09-ee51-4f51-a58b-a55c80281f19-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" released by "_create_volume_from_snapshot" :: held 4.210s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.218s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f244296-1cdc-4710-9c2d-4735e8d33c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12', 'volume_size': 1, 'snapshot_id': 'dac1bb09-ee51-4f51-a58b-a55c80281f19'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9977ebf-2abf-475f-8bce-6ce312b0dbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:34 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Volume volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12 (69829b21-dd10-44e5-9ee8-55ab0fb9cd12): created successfully
Apr 13 20:34:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9977ebf-2abf-475f-8bce-6ce312b0dbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Flow 'volume_create_manager' (8f6872d1-582e-400c-b75e-78d950656933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:34 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6db75325-b4ad-4f0e-be46-80f0147d9f59 tempest-VolumesSnapshotTestJSON-1007801857 None] Created volume successfully.
Apr 13 20:34:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-69829b21-dd10-44e5-9ee8-55ab0fb9cd12-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-69829b21-dd10-44e5-9ee8-55ab0fb9cd12-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:35 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d61879-cf78-45bb-a6b7-8d5427f408ea]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:35 devstack sudo[89742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12
Apr 13 20:34:35 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:35 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" returned: 0 in 0.487s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:35 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12
Apr 13 20:34:35 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:36 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" returned: 0 in 0.433s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-69829b21-dd10-44e5-9ee8-55ab0fb9cd12" released by "delete_volume" :: held 0.947s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Created reservations ['87bcf9df-e0e1-4020-99e9-0d8f7c55bfd7', '5103b311-551b-4117-a42a-287a2a78f088', 'bb7e47d7-8977-482f-87c2-bc86a11c009a', 'a80a4de3-1857-4ce3-80f6-6bf76375fecf'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:36 devstack sudo[89750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:34:36 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-dac1bb09-ee51-4f51-a58b-a55c80281f19-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-dac1bb09-ee51-4f51-a58b-a55c80281f19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-3d621c90-1575-41ca-b374-087778930987" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-3d621c90-1575-41ca-b374-087778930987" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-dac1bb09-ee51-4f51-a58b-a55c80281f19" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-dac1bb09-ee51-4f51-a58b-a55c80281f19" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Deleting offline snapshot dac1bb09-ee51-4f51-a58b-a55c80281f19 of volume 3d621c90-1575-41ca-b374-087778930987 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] snapshot_file for this snap is: volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78613d4-9d22-4071-8c38-90285d7ec544]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:36 devstack sudo[89752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19
Apr 13 20:34:36 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:36 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.436s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:34:36 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Deleted volume successfully.
Apr 13 20:34:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-52aa995f-04ae-43d6-ac89-68f308815ff0 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-69829b21-dd10-44e5-9ee8-55ab0fb9cd12-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:37 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19" returned: 0 in 0.504s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d621c90-1575-41ca-b374-087778930987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:34:37 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[013172e2-62d5-400b-b1cd-d710f1bae53c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:37 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987
Apr 13 20:34:37 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:37 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987" returned: 0 in 0.494s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:37 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19
Apr 13 20:34:37 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:37 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19" returned: 0 in 0.448s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:37 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19
Apr 13 20:34:37 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:38 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987.dac1bb09-ee51-4f51-a58b-a55c80281f19" returned: 0 in 0.407s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-dac1bb09-ee51-4f51-a58b-a55c80281f19" released by "_delete_snapshot" :: held 1.909s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-3d621c90-1575-41ca-b374-087778930987" released by "delete_snapshot" :: held 1.919s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:38 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Created reservations ['9b71f114-4a55-4113-8a25-2f6f88cb028a', 'ee365d64-ff07-4e1f-967c-8d4b6efd7055', '0e58634c-d347-4123-a580-0f88ee96420f', '4939fd77-4da0-4aca-b31e-86ee01c5c4b9'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:34:38 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Delete snapshot completed successfully.
Apr 13 20:34:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-84399a01-8b40-4559-b434-6eb971f6d99f tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-dac1bb09-ee51-4f51-a58b-a55c80281f19-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-3d621c90-1575-41ca-b374-087778930987-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-3d621c90-1575-41ca-b374-087778930987-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-3d621c90-1575-41ca-b374-087778930987" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-3d621c90-1575-41ca-b374-087778930987" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:38 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6689440a-1098-415a-b4c5-9c56cb24289e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:38 devstack sudo[89800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987
Apr 13 20:34:38 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:39 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987" returned: 0 in 0.546s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:39 devstack sudo[89808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987
Apr 13 20:34:39 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:39 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d621c90-1575-41ca-b374-087778930987" returned: 0 in 0.475s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-3d621c90-1575-41ca-b374-087778930987" released by "delete_volume" :: held 1.056s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:39 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Created reservations ['d8129d11-507d-4216-a16b-46c0dabd7990', '5e0caaaa-0d28-4f54-aeea-f97eb963d2fe', '72cac4bd-c60b-424d-911d-ff666f848b4f', '70c51754-f734-4870-ac00-00ab49d46199'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:34:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:39 devstack sudo[89811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:34:39 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:40 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.424s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:40 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:34:40 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Deleted volume successfully.
Apr 13 20:34:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-32b0b6c4-b951-4bbc-9040-471a517a8d99 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-3d621c90-1575-41ca-b374-087778930987-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-3f4f818e-8446-4ec4-a9f4-edf66928afe5-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-36e27d4c-9050-44f9-bb76-f0345f1088e6 tempest-VolumesActionsTest-1113337949 None] Acquiring lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234" by "attach_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-3f4f818e-8446-4ec4-a9f4-edf66928afe5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-36e27d4c-9050-44f9-bb76-f0345f1088e6 tempest-VolumesActionsTest-1113337949 None] Lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234" acquired by "attach_volume" :: waited 0.018s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "cinder-quobyte-3f4f818e-8446-4ec4-a9f4-edf66928afe5" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-36e27d4c-9050-44f9-bb76-f0345f1088e6 tempest-VolumesActionsTest-1113337949 None] Attaching volume e3f989b2-6b79-41fb-9afa-1b899c900234 to instance dd31f71c-d807-4c32-b705-a82287ee4321 at mountpoint /dev/vdb on host None.
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-3f4f818e-8446-4ec4-a9f4-edf66928afe5" acquired by "delete_volume" :: waited 0.025s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7dd6fa-bdd1-4088-989f-0b4e6034e8f7]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-36e27d4c-9050-44f9-bb76-f0345f1088e6 tempest-VolumesActionsTest-1113337949 None] Attach volume completed successfully.
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-36e27d4c-9050-44f9-bb76-f0345f1088e6 tempest-VolumesActionsTest-1113337949 None] Lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234" released by "attach_volume" :: held 0.116s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:41 devstack sudo[89814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5
Apr 13 20:34:41 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:41 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5" returned: 0 in 0.465s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:41 devstack sudo[89819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5
Apr 13 20:34:41 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c7fa687e-919a-453e-bfbc-7c702ee0accc tempest-VolumesActionsTest-1113337949 None] Acquiring lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234-detach_volume" by "detach_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c7fa687e-919a-453e-bfbc-7c702ee0accc tempest-VolumesActionsTest-1113337949 None] Lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:34:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c7fa687e-919a-453e-bfbc-7c702ee0accc tempest-VolumesActionsTest-1113337949 None] Detaching volume e3f989b2-6b79-41fb-9afa-1b899c900234 from instance dd31f71c-d807-4c32-b705-a82287ee4321.
Apr 13 20:34:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c7fa687e-919a-453e-bfbc-7c702ee0accc tempest-VolumesActionsTest-1113337949 None] Detach volume completed successfully.
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c7fa687e-919a-453e-bfbc-7c702ee0accc tempest-VolumesActionsTest-1113337949 None] Lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:41 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3f4f818e-8446-4ec4-a9f4-edf66928afe5" returned: 0 in 0.431s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-quobyte-3f4f818e-8446-4ec4-a9f4-edf66928afe5" released by "delete_volume" :: held 0.935s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:41 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Created reservations ['ab9162a4-ea16-4978-809f-d331f43ba6bb', 'ee6188f2-3daf-4a6c-83b0-ab1b99ba5b53', '3ce15a9a-4052-4516-8b25-fc550b0abcd5', 'daa1a68f-2900-428a-b610-6da7d5fbc723'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:34:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:42 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:42 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:42 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:34:42 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:42 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.433s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:42 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:34:42 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Deleted volume successfully.
Apr 13 20:34:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-eed7a0c2-1f89-46a1-b1b4-46251dd48d17 tempest-VolumesSnapshotTestJSON-1007801857 None] Lock "cinder-3f4f818e-8446-4ec4-a9f4-edf66928afe5-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Flow 'volume_create_manager' (bb25049c-fe5c-449c-8bdc-603cab12e14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87474c21-39b5-4149-94c5-a349cd377c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87474c21-39b5-4149-94c5-a349cd377c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-846712795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de55fad-58e1-433d-a9ed-972fdfb1785a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29b7a62fc2e4bcdb90e417cf9d1f044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:34:46Z,use_quota=True,user_id='c2bf43e9a22f46849ad411c2c6b586cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bc633b-eb62-44a7-9250-527646d79816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bc633b-eb62-44a7-9250-527646d79816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2c45b9-fb27-4583-a85c-e412d2530941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2c45b9-fb27-4583-a85c-e412d2530941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de55fad-58e1-433d-a9ed-972fdfb1785a', 'volume_name': 'volume-0de55fad-58e1-433d-a9ed-972fdfb1785a', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9115dd-e443-486e-bf24-8c4f984b39b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9115dd-e443-486e-bf24-8c4f984b39b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba61ec20-aea6-4f18-9980-94b8de917530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:46 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Volume 0de55fad-58e1-433d-a9ed-972fdfb1785a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de55fad-58e1-433d-a9ed-972fdfb1785a', 'volume_size': 1}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-846712795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de55fad-58e1-433d-a9ed-972fdfb1785a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29b7a62fc2e4bcdb90e417cf9d1f044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:34:46Z,use_quota=True,user_id='c2bf43e9a22f46849ad411c2c6b586cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Creating volume 0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:34:46 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:46 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a 1073741824
Apr 13 20:34:46 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:46 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a 1073741824" returned: 0 in 0.472s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:46 devstack sudo[89864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a
Apr 13 20:34:46 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:47 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a" returned: 0 in 0.420s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:34:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba61ec20-aea6-4f18-9980-94b8de917530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de55fad-58e1-433d-a9ed-972fdfb1785a', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cebec54-0a88-4c79-a1f0-10b1347503aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:34:47 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Volume volume-0de55fad-58e1-433d-a9ed-972fdfb1785a (0de55fad-58e1-433d-a9ed-972fdfb1785a): created successfully
Apr 13 20:34:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cebec54-0a88-4c79-a1f0-10b1347503aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:34:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Flow 'volume_create_manager' (bb25049c-fe5c-449c-8bdc-603cab12e14a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:34:47 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-816424b4-ed36-4a51-aa9d-10a27c511182 tempest-VolumesSnapshotListTestJSON-1353768391 None] Created volume successfully.
Apr 13 20:34:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] Creating offline snapshot a04739e1-4042-4259-9dd3-d684a9cf7cc8 of volume 0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:34:48 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[3616c1db-24a6-465f-989e-81e5f72b1f6d]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:48 devstack sudo[89867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a
Apr 13 20:34:48 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:49 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a" returned: 0 in 0.529s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:49 devstack sudo[89872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 1G
Apr 13 20:34:49 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:49 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 1G" returned: 0 in 0.556s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de55fad-58e1-433d-a9ed-972fdfb1785a -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:49 devstack sudo[89878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de55fad-58e1-433d-a9ed-972fdfb1785a -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8
Apr 13 20:34:49 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:50 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de55fad-58e1-433d-a9ed-972fdfb1785a -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8" returned: 0 in 0.417s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:50 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 is being set with open permissions: ugo+rw
Apr 13 20:34:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:50 devstack sudo[89883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8
Apr 13 20:34:50 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:50 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8" returned: 0 in 0.388s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:50 devstack sudo[89886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.info
Apr 13 20:34:50 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:50 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.info" returned: 0 in 0.417s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:50 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.info is being set with open permissions: ugo+rw
Apr 13 20:34:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:50 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.info
Apr 13 20:34:50 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:51 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.info" returned: 0 in 0.395s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.756s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.729s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:51 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[459eeb47-1f56-4a9c-bb82-0cf1eafc8045]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:51 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-21d9305e-fcbd-46a7-9c47-0f0649264b08 tempest-VolumesSnapshotListTestJSON-1353768391 None] Create snapshot completed successfully
Apr 13 20:34:51 devstack sudo[89892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234
Apr 13 20:34:51 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:51 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234" returned: 0 in 0.501s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:51 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97027e3-b8e7-440d-84ef-2a530eec5633]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:51 devstack sudo[89897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234
Apr 13 20:34:51 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:52 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234" returned: 0 in 0.460s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.987709cd-f357-46d1-bd98-f82257ebaf37vpggrg32.img {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:52 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.987709cd-f357-46d1-bd98-f82257ebaf37vpggrg32.img
Apr 13 20:34:52 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:54 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.987709cd-f357-46d1-bd98-f82257ebaf37vpggrg32.img" returned: 0 in 1.802s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:54 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[517667c0-e7a9-44de-a256-0decd45be823]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:34:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:54 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234
Apr 13 20:34:54 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:54 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234" returned: 0 in 0.571s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:54 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234, size 1024.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.987709cd-f357-46d1-bd98-f82257ebaf37vpggrg32.img {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:34:54 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] Converted 1024.00 MB image at 567.91 MB/s
Apr 13 20:34:54 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] 987709cd-f357-46d1-bd98-f82257ebaf37 was raw, no need to convert to raw {{(pid=82824) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 13 20:34:57 devstack cinder-volume[82824]: DEBUG oslo_service.periodic_task [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82824) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:34:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:34:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:34:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:34:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:34:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:34:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:34:57 devstack sudo[89919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:34:57 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:34:58 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root
Apr 13 20:34:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.447s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:34:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:01 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:UPDATE=72,cinder:SELECT=61,cinder:INSERT=16,cinder:DELETE=6 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:35:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.877s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:04 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] Uploaded volume to glance image-id: 987709cd-f357-46d1-bd98-f82257ebaf37. {{(pid=82824) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 13 20:35:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.411s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] Creating offline snapshot 8fb4f990-49e2-4499-b5e8-de7294671c65 of volume 0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:35:04 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3ff90b34-0a0d-4362-a303-a3a1f1e9db6e tempest-VolumesActionsTest-1113337949 None] Copy volume to image completed successfully.
Apr 13 20:35:04 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3e6e93-ce3b-4fe3-880e-f80c53143d5c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:04 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8
Apr 13 20:35:04 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:04 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8" returned: 0 in 0.452s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de55fad-58e1-433d-a9ed-972fdfb1785a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:04 devstack sudo[89928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 1G
Apr 13 20:35:04 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:05 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 1G" returned: 0 in 0.505s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:05 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65
Apr 13 20:35:05 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:05 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65" returned: 0 in 0.443s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:05 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 is being set with open permissions: ugo+rw
Apr 13 20:35:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:05 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65
Apr 13 20:35:05 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:06 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65" returned: 0 in 0.391s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.549s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:06 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cebbce9-63d3-4eac-bf05-b0b4a6f2d23b]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:06 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-4908326d-1134-435f-abf1-dfb2dc52e89f tempest-VolumesSnapshotListTestJSON-1353768391 None] Create snapshot completed successfully
Apr 13 20:35:06 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234
Apr 13 20:35:06 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:06 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234" returned: 0 in 0.496s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:06 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db6f573-a01b-41a7-a8a0-ce78f455db9d]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:06 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234
Apr 13 20:35:06 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:07 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234" returned: 0 in 0.470s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:07 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img
Apr 13 20:35:07 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:08 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img" returned: 0 in 1.873s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:08 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[899903de-f292-4777-97a7-7ae97bad8935]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:09 devstack sudo[89963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234
Apr 13 20:35:09 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:09 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234" returned: 0 in 0.590s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:09 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234, size 1024.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:35:09 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Converted 1024.00 MB image at 546.26 MB/s
Apr 13 20:35:09 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] ed191295-7b55-415d-9d93-85709df9fbfa was raw, converting to qcow2 {{(pid=82824) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 13 20:35:09 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1befc8ad-b20b-4823-9479-91b60bc28c41]: (4, 'raw') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:09 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img
Apr 13 20:35:09 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:10 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img" returned: 0 in 0.464s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:10 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img
Apr 13 20:35:10 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:10 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img" returned: 1 in 0.441s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img' failed. Not Retrying. {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 20:35:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img /opt/stack/data/cinder/conversion/vol_upload_seqp53f7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:10 devstack sudo[89984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img /opt/stack/data/cinder/conversion/vol_upload_seqp53f7
Apr 13 20:35:10 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:10 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img /opt/stack/data/cinder/conversion/vol_upload_seqp53f7" returned: 0 in 0.417s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:10 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Image conversion details: src /opt/stack/data/cinder/conversion/e3f989b2-6b79-41fb-9afa-1b899c900234.temp_image.ed191295-7b55-415d-9d93-85709df9fbfakw4ohzxc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_seqp53f7 {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:35:10 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 13 20:35:10 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25f13eb-a18b-4c19-adcd-89b695b1f9be]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_seqp53f7 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:10 devstack sudo[89989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_seqp53f7
Apr 13 20:35:10 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:11 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_seqp53f7" returned: 0 in 0.461s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.056s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:12 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Uploaded volume to glance image-id: ed191295-7b55-415d-9d93-85709df9fbfa. {{(pid=82824) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 13 20:35:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.770s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:12 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] Creating offline snapshot 0a24d903-e3b1-42fa-a0b5-f519b695cb66 of volume 0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:35:12 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-33eb7295-d544-42b7-8148-789a1afafb5a tempest-VolumesActionsTest-1113337949 None] Copy volume to image completed successfully.
Apr 13 20:35:12 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f9f62a-7cff-4636-b887-b5d3acc0c9c6]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:12 devstack sudo[89994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65
Apr 13 20:35:12 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:12 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65" returned: 0 in 0.468s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:12 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de55fad-58e1-433d-a9ed-972fdfb1785a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:12 devstack sudo[89999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66 1G
Apr 13 20:35:12 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:13 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66 1G" returned: 0 in 0.518s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:13 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66
Apr 13 20:35:13 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Acquiring lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Acquiring lock "cinder-quobyte-e3f989b2-6b79-41fb-9afa-1b899c900234" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Lock "cinder-quobyte-e3f989b2-6b79-41fb-9afa-1b899c900234" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baa986b-0075-4b3a-9ac6-098d48ed7f39]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:13 devstack sudo[90006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234
Apr 13 20:35:13 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:13 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66" returned: 0 in 0.457s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:13 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66 is being set with open permissions: ugo+rw
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:13 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66
Apr 13 20:35:13 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:13 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234" returned: 0 in 0.468s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:13 devstack sudo[90016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234
Apr 13 20:35:13 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:14 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66" returned: 0 in 0.413s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:14 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b232d35a-7c76-440f-a735-5c1644b4cd40 tempest-VolumesSnapshotListTestJSON-1353768391 None] Create snapshot completed successfully
Apr 13 20:35:14 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-e3f989b2-6b79-41fb-9afa-1b899c900234" returned: 0 in 0.399s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Lock "cinder-quobyte-e3f989b2-6b79-41fb-9afa-1b899c900234" released by "delete_volume" :: held 0.891s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Created reservations ['ad05047a-a42f-4ba2-807e-b927c1074c86', '60e068ad-e5ad-4ae8-90c6-4ee2d5c5d62e', '7b6cec4f-95fc-4bd3-99cc-abbff0a7aef2', 'c59096bd-69b3-4d44-a29a-4cfe70e76e70'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:14 devstack sudo[90020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:14 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:14 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.448s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:14 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Deleted volume successfully.
Apr 13 20:35:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d7dc0d37-eed0-4490-9ce7-ba172d49dbfb tempest-VolumesActionsTest-1113337949 None] Lock "cinder-e3f989b2-6b79-41fb-9afa-1b899c900234-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "cinder-0a24d903-e3b1-42fa-a0b5-f519b695cb66-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-0a24d903-e3b1-42fa-a0b5-f519b695cb66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "cinder-quobyte-0a24d903-e3b1-42fa-a0b5-f519b695cb66" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-0a24d903-e3b1-42fa-a0b5-f519b695cb66" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Deleting offline snapshot 0a24d903-e3b1-42fa-a0b5-f519b695cb66 of volume 0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] snapshot_file for this snap is: volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e847e0-76b2-4498-996d-0571192eadb8]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:15 devstack sudo[90023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66
Apr 13 20:35:15 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:15 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66" returned: 0 in 0.509s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de55fad-58e1-433d-a9ed-972fdfb1785a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[e287c983-3153-4ae1-b280-7b772f485bca]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:15 devstack sudo[90029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65
Apr 13 20:35:15 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:16 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65" returned: 0 in 0.634s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:16 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de55fad-58e1-433d-a9ed-972fdfb1785a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:16 devstack sudo[90035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66
Apr 13 20:35:16 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:17 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66" returned: 0 in 0.558s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:17 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66
Apr 13 20:35:17 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:17 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.0a24d903-e3b1-42fa-a0b5-f519b695cb66" returned: 0 in 0.439s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-0a24d903-e3b1-42fa-a0b5-f519b695cb66" released by "_delete_snapshot" :: held 2.188s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" released by "delete_snapshot" :: held 2.202s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:17 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Created reservations ['11d66761-2b4c-4485-9085-8d2f94268c1f', '379b15aa-db2b-481d-ad6d-2e5aa28c3708', 'fa0e15ba-28df-44b9-9949-42f74ed408bf', '9bcbf5e3-434b-4ff5-b729-e762a0c79497'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:17 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Delete snapshot completed successfully.
Apr 13 20:35:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-460774c5-f7b4-49ef-9e34-62108c8459dd tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-0a24d903-e3b1-42fa-a0b5-f519b695cb66-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:DELETE=6,cinder:UPDATE=79,cinder:SELECT=89,cinder:INSERT=25 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Flow 'volume_create_manager' (3c1f5bb2-9e78-4ece-a69c-a0b9c42dc01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95497114-5aaf-4661-b387-9961f01301a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95497114-5aaf-4661-b387-9961f01301a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-695199618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6a5de2-74f7-4641-8f3e-62c3aeec74ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2491bb368f8049a7865a81ea44dc1757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:18Z,use_quota=True,user_id='ab3af2b6eec6464e81a152d2ddb8111d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4471bc1-8870-425f-aa70-3a50e2972d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4471bc1-8870-425f-aa70-3a50e2972d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd22f62-8415-4483-8d4a-44ee9d7a87d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd22f62-8415-4483-8d4a-44ee9d7a87d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6a5de2-74f7-4641-8f3e-62c3aeec74ff', 'volume_name': 'volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b531f28-c6cb-4bcf-86b2-ccce2e701d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b531f28-c6cb-4bcf-86b2-ccce2e701d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b417e6cb-9954-4a93-9f1d-1edbd003d652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:18 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Volume 2e6a5de2-74f7-4641-8f3e-62c3aeec74ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff', 'volume_size': 1}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-695199618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6a5de2-74f7-4641-8f3e-62c3aeec74ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2491bb368f8049a7865a81ea44dc1757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:18Z,use_quota=True,user_id='ab3af2b6eec6464e81a152d2ddb8111d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Creating volume 2e6a5de2-74f7-4641-8f3e-62c3aeec74ff {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:35:18 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "cinder-8fb4f990-49e2-4499-b5e8-de7294671c65-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-8fb4f990-49e2-4499-b5e8-de7294671c65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:18 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff 1073741824
Apr 13 20:35:18 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "cinder-quobyte-8fb4f990-49e2-4499-b5e8-de7294671c65" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-8fb4f990-49e2-4499-b5e8-de7294671c65" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Deleting offline snapshot 8fb4f990-49e2-4499-b5e8-de7294671c65 of volume 0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] snapshot_file for this snap is: volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d600bf-0da5-4366-97e6-3ce861aa765a]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:18 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65
Apr 13 20:35:18 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:18 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff 1073741824" returned: 0 in 0.516s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:18 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65" returned: 0 in 0.488s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de55fad-58e1-433d-a9ed-972fdfb1785a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:18 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff
Apr 13 20:35:18 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1dbf44-a774-434e-be2b-f4cc010a473e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:19 devstack sudo[90090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8
Apr 13 20:35:19 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:19 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff" returned: 0 in 0.412s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b417e6cb-9954-4a93-9f1d-1edbd003d652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3751f178-3018-4547-b458-932b9a79b3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:19 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Volume volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff (2e6a5de2-74f7-4641-8f3e-62c3aeec74ff): created successfully
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3751f178-3018-4547-b458-932b9a79b3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Flow 'volume_create_manager' (3c1f5bb2-9e78-4ece-a69c-a0b9c42dc01a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:19 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-514d144d-0f1a-49e2-8c00-31d6e3261f19 tempest-VolumesCloneTest-789839898 None] Created volume successfully.
Apr 13 20:35:19 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8" returned: 0 in 0.490s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de55fad-58e1-433d-a9ed-972fdfb1785a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:19 devstack sudo[90097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65
Apr 13 20:35:19 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:19 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65" returned: 0 in 0.457s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:19 devstack sudo[90102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65
Apr 13 20:35:19 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:20 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.8fb4f990-49e2-4499-b5e8-de7294671c65" returned: 0 in 0.392s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-8fb4f990-49e2-4499-b5e8-de7294671c65" released by "_delete_snapshot" :: held 1.872s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" released by "delete_snapshot" :: held 1.883s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Created reservations ['41f7d2a3-fba8-4023-a7a3-7b985578348a', '40d907e8-762b-407d-a4e6-90d46b5c738b', '30687cd8-1bfd-46dc-8ae1-e4914240df4e', '41d6d132-e239-4413-aa9d-37f075c3c518'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:20 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Delete snapshot completed successfully.
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6e327233-c3d8-4aad-93ee-de01278bfc68 tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-8fb4f990-49e2-4499-b5e8-de7294671c65-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "cinder-a04739e1-4042-4259-9dd3-d684a9cf7cc8-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-a04739e1-4042-4259-9dd3-d684a9cf7cc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "cinder-quobyte-a04739e1-4042-4259-9dd3-d684a9cf7cc8" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-a04739e1-4042-4259-9dd3-d684a9cf7cc8" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Deleting offline snapshot a04739e1-4042-4259-9dd3-d684a9cf7cc8 of volume 0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] snapshot_file for this snap is: volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f286ae5-77dc-472a-9921-a54ca53f64f1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:20 devstack sudo[90105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8
Apr 13 20:35:20 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Flow 'volume_create_manager' (471b486c-e2d9-4dcc-abc1-9e8386e09eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91e25fa-4455-4c37-9d7f-5ea59d8a49f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91e25fa-4455-4c37-9d7f-5ea59d8a49f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1412093274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40514ff3-2795-410b-8fa4-1910721c072f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2491bb368f8049a7865a81ea44dc1757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=2e6a5de2-74f7-4641-8f3e-62c3aeec74ff,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:21Z,use_quota=True,user_id='ab3af2b6eec6464e81a152d2ddb8111d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649ac353-9106-4135-9a27-592079aa4ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649ac353-9106-4135-9a27-592079aa4ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323fb9fe-2390-4e21-b55a-da3605c8112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323fb9fe-2390-4e21-b55a-da3605c8112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '40514ff3-2795-410b-8fa4-1910721c072f', 'volume_name': 'volume-40514ff3-2795-410b-8fa4-1910721c072f', 'volume_size': 2, 'source_volid': '2e6a5de2-74f7-4641-8f3e-62c3aeec74ff', 'source_volstatus': 'available'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9602d1a5-c412-4926-a020-eb239e947b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9602d1a5-c412-4926-a020-eb239e947b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b85675-e020-454d-9a4d-91c9d1390dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:20 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Volume 40514ff3-2795-410b-8fa4-1910721c072f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-40514ff3-2795-410b-8fa4-1910721c072f', 'volume_size': 2, 'source_volid': '2e6a5de2-74f7-4641-8f3e-62c3aeec74ff', 'source_volstatus': 'available'}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:20 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Cloning volume 2e6a5de2-74f7-4641-8f3e-62c3aeec74ff to volume 40514ff3-2795-410b-8fa4-1910721c072f
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Creating offline snapshot c315d898-760a-41ee-9a61-d93170a41ed8 of volume 2e6a5de2-74f7-4641-8f3e-62c3aeec74ff {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b9146d-c256-4a9b-9487-a3e4cc648392]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:20 devstack sudo[90107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff
Apr 13 20:35:20 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:21 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8" returned: 0 in 0.508s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de55fad-58e1-433d-a9ed-972fdfb1785a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:21 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28e7647-2852-4f5a-818e-bb4f2875e66f]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:21 devstack sudo[90112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a
Apr 13 20:35:21 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:21 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff" returned: 0 in 0.467s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:21 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8 1G
Apr 13 20:35:21 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:21 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a" returned: 0 in 0.464s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:21 devstack sudo[90122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8
Apr 13 20:35:21 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:21 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8 1G" returned: 0 in 0.491s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:21 devstack sudo[90127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8
Apr 13 20:35:21 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:22 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8" returned: 0 in 0.459s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:22 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8
Apr 13 20:35:22 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:22 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8" returned: 0 in 0.418s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:22 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8 is being set with open permissions: ugo+rw
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:22 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8
Apr 13 20:35:22 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:22 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a.a04739e1-4042-4259-9dd3-d684a9cf7cc8" returned: 0 in 0.420s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-a04739e1-4042-4259-9dd3-d684a9cf7cc8" released by "_delete_snapshot" :: held 1.903s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" released by "delete_snapshot" :: held 1.913s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Created reservations ['99ca1eba-f9cf-4a3a-9e2e-ca1b27321544', '0b53a067-c8aa-4083-a699-d4cbecdb0070', '13ce3376-a2f2-426b-ae5b-4c425088ea43', 'b7e78a04-9f4e-46f3-81ce-9df2e00df2b3'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:22 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Delete snapshot completed successfully.
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b5007fb2-f04f-4471-bbbc-bc09e2506d1b tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-a04739e1-4042-4259-9dd3-d684a9cf7cc8-delete_snapshot" released by "delete_snapshot" :: held 1.988s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:22 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8" returned: 0 in 0.435s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:22 devstack sudo[90141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.info
Apr 13 20:35:22 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "cinder-0de55fad-58e1-433d-a9ed-972fdfb1785a-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-0de55fad-58e1-433d-a9ed-972fdfb1785a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[90194623-7f23-49b7-b72c-321750b3fe34]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:22 devstack sudo[90143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a
Apr 13 20:35:22 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:23 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.info" returned: 0 in 0.459s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:23 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.info is being set with open permissions: ugo+rw
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:23 devstack sudo[90146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.info
Apr 13 20:35:23 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:23 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a" returned: 0 in 0.468s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:23 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a
Apr 13 20:35:23 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:23 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.info" returned: 0 in 0.407s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Acquiring lock "cinder-quobyte-40514ff3-2795-410b-8fa4-1910721c072f" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Lock "cinder-quobyte-40514ff3-2795-410b-8fa4-1910721c072f" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] snapshot: c315d898-760a-41ee-9a61-d93170a41ed8, volume: 40514ff3-2795-410b-8fa4-1910721c072f,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a902ede-8661-4a84-899f-35cc1fc40d5e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:23 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8
Apr 13 20:35:23 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:23 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-0de55fad-58e1-433d-a9ed-972fdfb1785a" returned: 0 in 0.421s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-quobyte-0de55fad-58e1-433d-a9ed-972fdfb1785a" released by "delete_volume" :: held 0.917s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Created reservations ['c2864eea-fc6e-4fe3-adcf-47c3d7f2cbd2', '7aed0728-2ca7-44ce-baba-d4397392c892', '95b03a77-710d-4e1d-b021-e171b53098ea', 'df02c5cc-6a15-442e-ad84-2afdc9437296'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:23 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:23 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:24 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8" returned: 0 in 0.539s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1154ef03-d10f-44f8-bccf-b4107cf18497]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:24 devstack sudo[90162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff
Apr 13 20:35:24 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:24 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.497s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:24 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Deleted volume successfully.
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c56eaa3a-bdf0-4b69-b6e5-3cdba493b7ce tempest-VolumesSnapshotListTestJSON-1353768391 None] Lock "cinder-0de55fad-58e1-433d-a9ed-972fdfb1785a-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:24 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff" returned: 0 in 0.569s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:35:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:24 devstack sudo[90168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f
Apr 13 20:35:24 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (963cd12e-7bd8-428b-ab44-5e2d10830ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faacb762-6f52-4691-883d-7f144eec451a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faacb762-6f52-4691-883d-7f144eec451a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-691217479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85728f5-2bfa-44d7-b933-656698e27589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:26Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d0f74e-f042-457d-aff6-269ce1af5ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d0f74e-f042-457d-aff6-269ce1af5ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0f79aa-e7fe-4475-960a-efc75e440431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0f79aa-e7fe-4475-960a-efc75e440431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c85728f5-2bfa-44d7-b933-656698e27589', 'volume_name': 'volume-c85728f5-2bfa-44d7-b933-656698e27589', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9f6c7f-a503-4a81-b703-c6ead3700f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9f6c7f-a503-4a81-b703-c6ead3700f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330e713c-31c8-4cdd-a292-bfa7b8a11b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:26 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume c85728f5-2bfa-44d7-b933-656698e27589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c85728f5-2bfa-44d7-b933-656698e27589', 'volume_size': 1}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:26 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f" returned: 0 in 2.050s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ff6ea8-d588-410a-8a86-8ac0759b5505]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:26 devstack sudo[90180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff
Apr 13 20:35:26 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:27 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff" returned: 0 in 0.616s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:27 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff, size 1024.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:35:27 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Converted 1024.00 MB image at 499.37 MB/s
Apr 13 20:35:27 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f is being set with open permissions: ugo+rw
Apr 13 20:35:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:27 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f
Apr 13 20:35:27 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:27 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f" returned: 0 in 0.404s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:27 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Lock "cinder-quobyte-40514ff3-2795-410b-8fa4-1910721c072f" released by "_copy_volume_from_snapshot" :: held 4.217s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:27 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Acquiring lock "cinder-quobyte-c315d898-760a-41ee-9a61-d93170a41ed8" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:27 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Lock "cinder-quobyte-c315d898-760a-41ee-9a61-d93170a41ed8" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Deleting offline snapshot c315d898-760a-41ee-9a61-d93170a41ed8 of volume 2e6a5de2-74f7-4641-8f3e-62c3aeec74ff {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:35:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] snapshot_file for this snap is: volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:35:27 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e5757c-2ec2-41a8-8730-12d2a911b571]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:27 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8
Apr 13 20:35:27 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:28 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8" returned: 0 in 0.471s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:28 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9298b6a-f5db-45da-837c-065fffb49587]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:28 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff
Apr 13 20:35:28 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:28 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff" returned: 0 in 0.463s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:28 devstack sudo[90199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8
Apr 13 20:35:28 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:29 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8" returned: 0 in 0.460s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:29 devstack sudo[90204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8
Apr 13 20:35:29 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:29 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff.c315d898-760a-41ee-9a61-d93170a41ed8" returned: 0 in 0.414s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Lock "cinder-quobyte-c315d898-760a-41ee-9a61-d93170a41ed8" released by "_delete_snapshot" :: held 1.853s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.854s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.313s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-691217479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85728f5-2bfa-44d7-b933-656698e27589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:26Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Creating volume c85728f5-2bfa-44d7-b933-656698e27589 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:35:29 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b85675-e020-454d-9a4d-91c9d1390dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40514ff3-2795-410b-8fa4-1910721c072f', 'volume_size': 2, 'source_volid': '2e6a5de2-74f7-4641-8f3e-62c3aeec74ff', 'source_volstatus': 'available'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:29 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589 1073741824
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023618ed-e806-4241-ad8c-1d8ff7b15a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:29 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:29 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Volume volume-40514ff3-2795-410b-8fa4-1910721c072f (40514ff3-2795-410b-8fa4-1910721c072f): created successfully
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023618ed-e806-4241-ad8c-1d8ff7b15a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Flow 'volume_create_manager' (471b486c-e2d9-4dcc-abc1-9e8386e09eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:29 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-7839c2ba-e704-48be-8cd0-dea5ca3e57ee tempest-VolumesCloneTest-789839898 None] Created volume successfully.
Apr 13 20:35:30 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589 1073741824" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:30 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589
Apr 13 20:35:30 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Acquiring lock "cinder-40514ff3-2795-410b-8fa4-1910721c072f-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Lock "cinder-40514ff3-2795-410b-8fa4-1910721c072f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Acquiring lock "cinder-quobyte-40514ff3-2795-410b-8fa4-1910721c072f" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Lock "cinder-quobyte-40514ff3-2795-410b-8fa4-1910721c072f" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f36540-432c-4c23-a928-61dae8a91700]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:30 devstack sudo[90215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f
Apr 13 20:35:30 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:30 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589" returned: 0 in 0.425s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330e713c-31c8-4cdd-a292-bfa7b8a11b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c85728f5-2bfa-44d7-b933-656698e27589', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2787a79f-8a09-46f5-947b-318ea14ebe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:30 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume volume-c85728f5-2bfa-44d7-b933-656698e27589 (c85728f5-2bfa-44d7-b933-656698e27589): created successfully
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2787a79f-8a09-46f5-947b-318ea14ebe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (963cd12e-7bd8-428b-ab44-5e2d10830ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:30 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3045e079-ed51-4575-ad8c-65b90c726b96 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created volume successfully.
Apr 13 20:35:30 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f" returned: 0 in 0.465s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:30 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f
Apr 13 20:35:30 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:31 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-40514ff3-2795-410b-8fa4-1910721c072f" returned: 0 in 0.395s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Lock "cinder-quobyte-40514ff3-2795-410b-8fa4-1910721c072f" released by "delete_volume" :: held 0.891s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Created reservations ['4e9a9890-5411-4c15-bae0-f15c460d9296', '5b9003fc-ae5f-4e5b-ab9f-9380d486340a', 'd9a62519-26af-4010-b011-d1015dd6b5b5', '6c3cae34-f7e9-4b86-9248-71f699d0713a'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:31 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:31 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Acquiring lock "cinder-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Creating offline snapshot d5d4f3df-ec7c-4270-b8bb-80997e538d5c of volume c85728f5-2bfa-44d7-b933-656698e27589 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Lock "cinder-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf0f9e7-f4e1-4dd4-9b25-f2b202af5af2]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Acquiring lock "cinder-quobyte-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Lock "cinder-quobyte-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[4430b478-db53-46a3-8c6a-f733105f09a1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:31 devstack sudo[90226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589
Apr 13 20:35:31 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:31 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff
Apr 13 20:35:31 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:31 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.447s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Deleted volume successfully.
Apr 13 20:35:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-97ec2e57-91fd-4661-bfd4-6d4159b0c6e9 tempest-VolumesCloneTest-789839898 None] Lock "cinder-40514ff3-2795-410b-8fa4-1910721c072f-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:32 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589" returned: 0 in 0.479s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:32 devstack sudo[90237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c 1G
Apr 13 20:35:32 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:32 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff" returned: 0 in 0.481s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:32 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff
Apr 13 20:35:32 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:32 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c 1G" returned: 0 in 0.455s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c85728f5-2bfa-44d7-b933-656698e27589 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:32 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff" returned: 0 in 0.415s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:32 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c85728f5-2bfa-44d7-b933-656698e27589 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c
Apr 13 20:35:32 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Lock "cinder-quobyte-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff" released by "delete_volume" :: held 0.923s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Created reservations ['7e817f52-1ed7-4928-bcb6-5ea620954f57', '2f3c8f04-2441-4e33-a7d3-908a977c915f', '4e2447dc-ca4c-4e2c-bec2-2bdd769aed79', 'c91b90e1-afd4-429b-9376-72c99c715735'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:32 devstack sudo[90247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:32 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:33 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c85728f5-2bfa-44d7-b933-656698e27589 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c" returned: 0 in 0.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:33 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c is being set with open permissions: ugo+rw
Apr 13 20:35:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:33 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c
Apr 13 20:35:33 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:33 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.474s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:33 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:33 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Deleted volume successfully.
Apr 13 20:35:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2219fb94-084e-47a2-a3a5-f769dc206490 tempest-VolumesCloneTest-789839898 None] Lock "cinder-2e6a5de2-74f7-4641-8f3e-62c3aeec74ff-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:33 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c" returned: 0 in 0.497s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:33 devstack sudo[90256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.info
Apr 13 20:35:33 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:34 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.info" returned: 0 in 0.498s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:34 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.info is being set with open permissions: ugo+rw
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:34 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.info
Apr 13 20:35:34 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Flow 'volume_create_manager' (3f52ad16-4049-4149-90c7-b40140fa7ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be15319-720c-47fe-869c-09b291f7a4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be15319-720c-47fe-869c-09b291f7a4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1189425453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f88001a-51e3-42b6-b0cf-d39e8ae9cff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5e1b4f318344db95f50a0a24040785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:34Z,use_quota=True,user_id='e553a6b85cf746b7aeae44c3a7fdd7b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a88f95d-7524-4a33-9834-06594bd1ed75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a88f95d-7524-4a33-9834-06594bd1ed75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3149f2-8c07-4427-b2c0-85ecacdb135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3149f2-8c07-4427-b2c0-85ecacdb135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f88001a-51e3-42b6-b0cf-d39e8ae9cff8', 'volume_name': 'volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8', 'volume_size': 2}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6eb2e7d-8fa5-4952-9f3e-448f0564e82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6eb2e7d-8fa5-4952-9f3e-448f0564e82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ef4f27-a8e5-4b2e-a2ad-5a6dfcd4aa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:34 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Volume 4f88001a-51e3-42b6-b0cf-d39e8ae9cff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8', 'volume_size': 2}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:34 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.info" returned: 0 in 0.415s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.899s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.079s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1189425453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f88001a-51e3-42b6-b0cf-d39e8ae9cff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5e1b4f318344db95f50a0a24040785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:34Z,use_quota=True,user_id='e553a6b85cf746b7aeae44c3a7fdd7b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Creating volume 4f88001a-51e3-42b6-b0cf-d39e8ae9cff8 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:35:34 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8 2147483648 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:34 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8 2147483648
Apr 13 20:35:34 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:34 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-896be3b5-baf7-4e18-b592-cd326a045fd5 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Create snapshot completed successfully
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (02efff79-eefc-4c89-8d2b-108fa01115bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f86573-d0b9-4801-a5e8-c76764fedab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f86573-d0b9-4801-a5e8-c76764fedab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064161811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615ab210-0069-4a33-9def-9fb56284b628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:35Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45872d3a-6ba2-4e0a-a6a8-901482ae55a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45872d3a-6ba2-4e0a-a6a8-901482ae55a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768b14ae-90be-4e3f-be8f-6f2e6065aa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768b14ae-90be-4e3f-be8f-6f2e6065aa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '615ab210-0069-4a33-9def-9fb56284b628', 'volume_name': 'volume-615ab210-0069-4a33-9def-9fb56284b628', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64ae448-81da-44c4-a735-f78073c33b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64ae448-81da-44c4-a735-f78073c33b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd711f8-5984-4960-8c79-598ab43df088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:34 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume 615ab210-0069-4a33-9def-9fb56284b628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-615ab210-0069-4a33-9def-9fb56284b628', 'volume_size': 1}
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:34 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8 2147483648" returned: 0 in 0.526s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:35 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8
Apr 13 20:35:35 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (b9581e1b-b5ce-4fe2-91f0-751df0b1c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25027d75-e6a2-4061-b896-191189b13b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25027d75-e6a2-4061-b896-191189b13b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1359670186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:35Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a10622c-f425-4f96-bd66-87f7a7377166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a10622c-f425-4f96-bd66-87f7a7377166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce52425-3772-48a2-9dd7-cab7b7ea8bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce52425-3772-48a2-9dd7-cab7b7ea8bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8', 'volume_name': 'volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c2ea82-56b8-44c2-9ca7-5110c84851e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c2ea82-56b8-44c2-9ca7-5110c84851e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6b7b06-e937-4a3a-9063-be343466ffc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8', 'volume_size': 1}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (8ba4efb5-404f-4103-8f94-cdd0769a6541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f263c9-e3f6-4a25-bb2f-75de1da21881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f263c9-e3f6-4a25-bb2f-75de1da21881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13751286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c284e3e6-cf7b-4032-9d44-382ad54f31c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:35Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f0c3c9-5063-4997-b282-814badd453bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f0c3c9-5063-4997-b282-814badd453bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1944be-b9a8-485d-a855-e9eda7c274ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1944be-b9a8-485d-a855-e9eda7c274ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c284e3e6-cf7b-4032-9d44-382ad54f31c8', 'volume_name': 'volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3589dc26-49db-489e-8831-d5d8acf7881b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3589dc26-49db-489e-8831-d5d8acf7881b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2450e693-2c3d-449b-afdb-3bb5af1c163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume c284e3e6-cf7b-4032-9d44-382ad54f31c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8', 'volume_size': 1}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:35 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (4caa3e72-e8b9-45d8-877f-bb3ed01f0bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dc5d01-1d2e-4f21-8b76-a74edfe9e4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8" returned: 0 in 0.512s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064161811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615ab210-0069-4a33-9def-9fb56284b628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:35Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Creating volume 615ab210-0069-4a33-9def-9fb56284b628 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:35:35 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dc5d01-1d2e-4f21-8b76-a74edfe9e4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037025436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25c44f8-a1e3-43c4-864c-f55f3c94d796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:35Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628 1073741824
Apr 13 20:35:35 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ecbc0a-dbe6-4404-8fc1-6ac93029d65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ecbc0a-dbe6-4404-8fc1-6ac93029d65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af4d818-80e7-4b2d-a1cd-8d7e2f8dff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af4d818-80e7-4b2d-a1cd-8d7e2f8dff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd25c44f8-a1e3-43c4-864c-f55f3c94d796', 'volume_name': 'volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a252cce1-dac6-40fc-8f4a-56de199636c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a252cce1-dac6-40fc-8f4a-56de199636c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abc7073-d236-4c75-a6e7-f0770ab59303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume d25c44f8-a1e3-43c4-864c-f55f3c94d796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796', 'volume_size': 1}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ef4f27-a8e5-4b2e-a2ad-5a6dfcd4aa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8', 'volume_size': 2}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0c1434-3fda-4378-b418-34abd3a1a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Volume volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8 (4f88001a-51e3-42b6-b0cf-d39e8ae9cff8): created successfully
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0c1434-3fda-4378-b418-34abd3a1a86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Flow 'volume_create_manager' (3f52ad16-4049-4149-90c7-b40140fa7ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:35 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-07bb6c8b-6aed-4300-8d18-0379280039b4 tempest-VolumesCloneNegativeTest-1832555884 None] Created volume successfully.
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (53f05976-2634-48b8-9a1e-110a30f33f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7506009-3407-4ad8-8317-a933d083324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7506009-3407-4ad8-8317-a933d083324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-752946151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f2cf39-8cf3-435e-a59d-722e491535f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:36Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc12882-90d5-4453-8d1d-89d7d785c99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc12882-90d5-4453-8d1d-89d7d785c99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15e150b-b716-4091-9432-22eb686ec348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15e150b-b716-4091-9432-22eb686ec348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f2cf39-8cf3-435e-a59d-722e491535f6', 'volume_name': 'volume-39f2cf39-8cf3-435e-a59d-722e491535f6', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6397c1-3a93-457d-ac07-d17786492ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6397c1-3a93-457d-ac07-d17786492ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505c67a2-d92c-44e7-bf21-0ffb7eed213c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:35 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume 39f2cf39-8cf3-435e-a59d-722e491535f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f2cf39-8cf3-435e-a59d-722e491535f6', 'volume_size': 1}
Apr 13 20:35:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:36 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628 1073741824" returned: 0 in 0.529s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:36 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628
Apr 13 20:35:36 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:36 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628" returned: 0 in 0.419s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.325s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1359670186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:35Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Creating volume d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:35:36 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Acquiring lock "cinder-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:36 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8 1073741824
Apr 13 20:35:36 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd711f8-5984-4960-8c79-598ab43df088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-615ab210-0069-4a33-9def-9fb56284b628', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7221772d-d2d5-446f-ad1c-77d942d146a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Lock "cinder-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:36 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume volume-615ab210-0069-4a33-9def-9fb56284b628 (615ab210-0069-4a33-9def-9fb56284b628): created successfully
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7221772d-d2d5-446f-ad1c-77d942d146a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (02efff79-eefc-4c89-8d2b-108fa01115bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:36 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5c996659-6518-4280-a283-e60eb59a5506 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created volume successfully.
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Acquiring lock "cinder-quobyte-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Lock "cinder-quobyte-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0690af50-dd5d-4a7f-bab9-ce1a5b1fa178]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:36 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:36 devstack sudo[90280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8
Apr 13 20:35:36 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:37 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8 1073741824" returned: 0 in 0.512s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:37 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8
Apr 13 20:35:37 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:37 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8" returned: 0 in 0.512s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:37 devstack sudo[90290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8
Apr 13 20:35:37 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:37 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8" returned: 0 in 0.403s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.119s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13751286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c284e3e6-cf7b-4032-9d44-382ad54f31c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:35Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Creating volume c284e3e6-cf7b-4032-9d44-382ad54f31c8 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:35:37 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6b7b06-e937-4a3a-9063-be343466ffc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c416d5b-f0ba-4f5b-b8bc-351a618f18c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:37 devstack sudo[90294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8 1073741824
Apr 13 20:35:37 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:37 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8 (d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8): created successfully
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c416d5b-f0ba-4f5b-b8bc-351a618f18c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (b9581e1b-b5ce-4fe2-91f0-751df0b1c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:37 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-95c69938-f521-4763-91a9-128e81cfcac1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created volume successfully.
Apr 13 20:35:37 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8" returned: 0 in 0.416s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Lock "cinder-quobyte-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8" released by "delete_volume" :: held 0.958s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Created reservations ['b1d904e7-0a0b-4948-b772-e7aee7a8aa2d', '4b8c24b4-4451-4024-89a6-d8a05dea6e71', 'f740ddb6-95db-41da-b427-eedcaf681d47', '0f443564-1ae0-4725-b0d7-3f5475eae653'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:37 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:37 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:38 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8 1073741824" returned: 0 in 0.534s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:38 devstack sudo[90301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8
Apr 13 20:35:38 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:38 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.494s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:38 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Deleted volume successfully.
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-306cb634-42e0-4126-a8d0-50026c741558 tempest-VolumesCloneNegativeTest-1832555884 None] Lock "cinder-4f88001a-51e3-42b6-b0cf-d39e8ae9cff8-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:38 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8" returned: 0 in 0.448s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.878s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037025436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25c44f8-a1e3-43c4-864c-f55f3c94d796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:35Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Creating volume d25c44f8-a1e3-43c4-864c-f55f3c94d796 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:35:38 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2450e693-2c3d-449b-afdb-3bb5af1c163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46acc45c-ac2e-4f1e-93d9-234a0ec2faf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:38 devstack sudo[90306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796 1073741824
Apr 13 20:35:38 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:38 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8 (c284e3e6-cf7b-4032-9d44-382ad54f31c8): created successfully
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46acc45c-ac2e-4f1e-93d9-234a0ec2faf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (8ba4efb5-404f-4103-8f94-cdd0769a6541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:38 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-acf7a0fa-e3e0-4f96-96b8-22be4dc2849e tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created volume successfully.
Apr 13 20:35:39 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796 1073741824" returned: 0 in 0.515s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:39 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796
Apr 13 20:35:39 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Flow 'volume_create_manager' (f72e665f-cfdc-4641-88bf-6f99e367045e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db963140-206b-44dd-b68b-620c529e11d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:39 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db963140-206b-44dd-b68b-620c529e11d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-431385536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abce3c3d-bccf-4c18-9d7f-e38bb46846b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3080270a8e749c0a74f9ac9bd9a25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:39Z,use_quota=True,user_id='2e07287fad91461c8b3e5cf34c2f5bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff1e05b-a664-4125-82f6-da430b460986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff1e05b-a664-4125-82f6-da430b460986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120b2548-8166-4e61-a7e5-fdbfad80dbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120b2548-8166-4e61-a7e5-fdbfad80dbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abce3c3d-bccf-4c18-9d7f-e38bb46846b3', 'volume_name': 'volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969b902a-e694-407d-b99c-d6f41cc90968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969b902a-e694-407d-b99c-d6f41cc90968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650fb34f-d8b7-4fad-8176-46e1acf94f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:39 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Volume abce3c3d-bccf-4c18-9d7f-e38bb46846b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3', 'volume_size': 1}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796" returned: 0 in 0.470s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.773s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-752946151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f2cf39-8cf3-435e-a59d-722e491535f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51a68afbd054badac188707a790a6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:36Z,use_quota=True,user_id='be5eb9e91eb54aceb8812aa992cc5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Creating volume 39f2cf39-8cf3-435e-a59d-722e491535f6 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:35:39 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abc7073-d236-4c75-a6e7-f0770ab59303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b91890-f2cd-47dd-b7c8-a7071118f192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:39 devstack sudo[90315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6 1073741824
Apr 13 20:35:39 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:39 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796 (d25c44f8-a1e3-43c4-864c-f55f3c94d796): created successfully
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b91890-f2cd-47dd-b7c8-a7071118f192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (4caa3e72-e8b9-45d8-877f-bb3ed01f0bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:39 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0da06d49-7cc5-4c13-87c5-19eeb4852971 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created volume successfully.
Apr 13 20:35:39 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6 1073741824" returned: 0 in 0.477s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:40 devstack sudo[90320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6
Apr 13 20:35:40 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:40 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6" returned: 0 in 0.421s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-431385536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abce3c3d-bccf-4c18-9d7f-e38bb46846b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3080270a8e749c0a74f9ac9bd9a25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:39Z,use_quota=True,user_id='2e07287fad91461c8b3e5cf34c2f5bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Creating volume abce3c3d-bccf-4c18-9d7f-e38bb46846b3 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:35:40 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505c67a2-d92c-44e7-bf21-0ffb7eed213c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f2cf39-8cf3-435e-a59d-722e491535f6', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e412ac3c-b05c-4b53-a3e0-fb9ea92f0ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:40 devstack sudo[90323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 1073741824
Apr 13 20:35:40 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:40 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Volume volume-39f2cf39-8cf3-435e-a59d-722e491535f6 (39f2cf39-8cf3-435e-a59d-722e491535f6): created successfully
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e412ac3c-b05c-4b53-a3e0-fb9ea92f0ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Flow 'volume_create_manager' (53f05976-2634-48b8-9a1e-110a30f33f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:40 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-dafd9290-fc7f-4527-8a9e-acb7fd5e6fbf tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created volume successfully.
Apr 13 20:35:40 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 1073741824" returned: 0 in 0.494s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:40 devstack sudo[90328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3
Apr 13 20:35:40 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-39f2cf39-8cf3-435e-a59d-722e491535f6-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-39f2cf39-8cf3-435e-a59d-722e491535f6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-quobyte-39f2cf39-8cf3-435e-a59d-722e491535f6" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-39f2cf39-8cf3-435e-a59d-722e491535f6" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef2c227-745b-44bc-a6c8-d077ae9a2a48]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:41 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6
Apr 13 20:35:41 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:41 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" returned: 0 in 0.421s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650fb34f-d8b7-4fad-8176-46e1acf94f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1dbbba-5024-41b4-8977-8d4f1d5417cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:41 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Volume volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 (abce3c3d-bccf-4c18-9d7f-e38bb46846b3): created successfully
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1dbbba-5024-41b4-8977-8d4f1d5417cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Flow 'volume_create_manager' (f72e665f-cfdc-4641-88bf-6f99e367045e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-71f66dd1-0e03-40ba-8a9a-514ada323dee tempest-VolumeDependencyTests-1132105655 None] Created volume successfully.
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] Creating offline snapshot 7252c16b-4e6f-4091-a788-2ef6820172b6 of volume abce3c3d-bccf-4c18-9d7f-e38bb46846b3 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[412add0d-5c52-4997-b45c-b22413a18a4e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:41 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6" returned: 0 in 0.510s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:41 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3
Apr 13 20:35:41 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6
Apr 13 20:35:41 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:41 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:42 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39f2cf39-8cf3-435e-a59d-722e491535f6" returned: 0 in 0.405s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-39f2cf39-8cf3-435e-a59d-722e491535f6" released by "delete_volume" :: held 0.937s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:42 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" returned: 0 in 0.478s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:42 devstack sudo[90344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6 1G
Apr 13 20:35:42 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created reservations ['22c5ec71-9caf-438b-913a-3ec70078210f', 'da22de26-ca16-410e-a248-0c6d99a73e04', 'c6d0449f-a24a-41d8-a171-6bdcee44ca6a', '3f41ab05-3ba3-4ada-b484-4c471ab877bf'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:42 devstack sudo[90346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:42 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-d25c44f8-a1e3-43c4-864c-f55f3c94d796-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-d25c44f8-a1e3-43c4-864c-f55f3c94d796-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-quobyte-d25c44f8-a1e3-43c4-864c-f55f3c94d796" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-d25c44f8-a1e3-43c4-864c-f55f3c94d796" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[97709d06-fb6f-456c-981c-9e6f2d52ff2e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:42 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796
Apr 13 20:35:42 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:42 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6 1G" returned: 0 in 0.501s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:42 devstack sudo[90354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6
Apr 13 20:35:42 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:42 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.473s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:42 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Deleted volume successfully.
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e409aa2b-6035-4018-a300-48434d386269 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-39f2cf39-8cf3-435e-a59d-722e491535f6-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:42 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796" returned: 0 in 0.494s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:42 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796
Apr 13 20:35:42 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:43 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6" returned: 0 in 0.448s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:43 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6 is being set with open permissions: ugo+rw
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:43 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6
Apr 13 20:35:43 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:43 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d25c44f8-a1e3-43c4-864c-f55f3c94d796" returned: 0 in 0.422s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-d25c44f8-a1e3-43c4-864c-f55f3c94d796" released by "delete_volume" :: held 0.949s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created reservations ['b75db221-40fa-440f-9f7e-6cc900bc731c', '09800dd1-775c-4be8-a290-ae11fc1b14c5', 'ce94530f-e60f-498c-9f85-11bf70bcfb56', '6ff134fb-d953-4d71-b1e7-839fc6776b95'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:43 devstack sudo[90369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:43 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-c284e3e6-cf7b-4032-9d44-382ad54f31c8-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-c284e3e6-cf7b-4032-9d44-382ad54f31c8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-quobyte-c284e3e6-cf7b-4032-9d44-382ad54f31c8" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-c284e3e6-cf7b-4032-9d44-382ad54f31c8" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb451b4-e384-48e5-84d8-3608a6f40f5f]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:43 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6" returned: 0 in 0.449s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:43 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8
Apr 13 20:35:43 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:43 devstack sudo[90374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.info
Apr 13 20:35:43 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:43 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.436s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:43 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Deleted volume successfully.
Apr 13 20:35:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b2216f3f-3a14-47e6-a7fa-a406bf03e4e1 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-d25c44f8-a1e3-43c4-864c-f55f3c94d796-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:44 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8" returned: 0 in 0.508s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:44 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.info" returned: 0 in 0.442s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:44 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.info is being set with open permissions: ugo+rw
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:44 devstack sudo[90381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8
Apr 13 20:35:44 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:44 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.info
Apr 13 20:35:44 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:44 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c284e3e6-cf7b-4032-9d44-382ad54f31c8" returned: 0 in 0.425s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-c284e3e6-cf7b-4032-9d44-382ad54f31c8" released by "delete_volume" :: held 0.954s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:44 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.info" returned: 0 in 0.422s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.791s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:44 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f0370b54-1dc2-4e13-9052-cf95a04896fc tempest-VolumeDependencyTests-1132105655 None] Create snapshot completed successfully
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created reservations ['71380b83-4908-4d06-a398-f2e6e044ba25', '9e47a6de-f94d-4504-9747-4b592a218ee2', '9f6c3bd8-346d-49e5-b86e-1855ce94278a', '6e3e1c60-2a28-4aec-8a23-8b510426eae9'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:44 devstack sudo[90387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:44 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:45 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.481s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:45 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Deleted volume successfully.
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1820f9ab-7ee3-46b1-8e05-211cd59eb891 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-c284e3e6-cf7b-4032-9d44-382ad54f31c8-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Flow 'volume_create_manager' (98a10f16-ea86-4fa4-95d5-50aa03171c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f078d6b-86da-4546-bbe6-eaafa82d5055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f078d6b-86da-4546-bbe6-eaafa82d5055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-308012714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d7f9d1-4efd-468a-8b32-a550952aef6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3080270a8e749c0a74f9ac9bd9a25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7252c16b-4e6f-4091-a788-2ef6820172b6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:45Z,use_quota=True,user_id='2e07287fad91461c8b3e5cf34c2f5bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddab4bbb-6c11-4a91-8b65-a4749a36f5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddab4bbb-6c11-4a91-8b65-a4749a36f5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d917da-5070-4770-8339-2ab9bb39bf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d917da-5070-4770-8339-2ab9bb39bf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd9d7f9d1-4efd-468a-8b32-a550952aef6e', 'volume_name': 'volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e', 'volume_size': 1, 'snapshot_id': '7252c16b-4e6f-4091-a788-2ef6820172b6'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5d3cbc-4a98-4fa8-aefd-79d3b4f8f183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5d3cbc-4a98-4fa8-aefd-79d3b4f8f183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237cecec-509a-4776-930b-b674598d3d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:45 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Volume d9d7f9d1-4efd-468a-8b32-a550952aef6e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e', 'volume_size': 1, 'snapshot_id': '7252c16b-4e6f-4091-a788-2ef6820172b6'}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-quobyte-7252c16b-4e6f-4091-a788-2ef6820172b6-d9d7f9d1-4efd-468a-8b32-a550952aef6e" by "_create_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-7252c16b-4e6f-4091-a788-2ef6820172b6-d9d7f9d1-4efd-468a-8b32-a550952aef6e" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Creating volume d9d7f9d1-4efd-468a-8b32-a550952aef6e from snapshot 7252c16b-4e6f-4091-a788-2ef6820172b6 {{(pid=82824) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-quobyte-d9d7f9d1-4efd-468a-8b32-a550952aef6e" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-d9d7f9d1-4efd-468a-8b32-a550952aef6e" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] snapshot: 7252c16b-4e6f-4091-a788-2ef6820172b6, volume: d9d7f9d1-4efd-468a-8b32-a550952aef6e,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec24d6f-f986-4670-b042-9010ac412a75]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:45 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6
Apr 13 20:35:45 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-quobyte-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cea2b68-71cb-4c25-817a-2afc3830f05c]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:45 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6" returned: 0 in 0.527s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ee2783-b394-4cf6-9ba5-9326666c32de]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:45 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8
Apr 13 20:35:45 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:45 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3
Apr 13 20:35:45 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:46 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8" returned: 0 in 0.481s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:46 devstack sudo[90405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8
Apr 13 20:35:46 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:46 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:46 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e
Apr 13 20:35:46 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:46 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8" returned: 0 in 0.405s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8" released by "delete_volume" :: held 0.911s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created reservations ['287fc4c6-3599-4f4b-9354-868f75a16a84', 'd19fadab-f4dc-47f1-bf3d-8aad915795f7', 'a160f87a-7b58-4d1e-bc27-e302110f221e', 'fa5c16d5-93e8-4fac-adee-80f11e0dec99'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:46 devstack sudo[90420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:46 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-615ab210-0069-4a33-9def-9fb56284b628-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-615ab210-0069-4a33-9def-9fb56284b628-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-quobyte-615ab210-0069-4a33-9def-9fb56284b628" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-615ab210-0069-4a33-9def-9fb56284b628" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:47 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[404aa8d2-39a7-4f94-9c1e-a34476671365]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:47 devstack sudo[90422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628
Apr 13 20:35:47 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:47 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 1.081s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:47 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:47 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Deleted volume successfully.
Apr 13 20:35:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-1e34f9a9-21f9-48dc-9d25-2ee1df624d7b tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-d8b7c1d8-f8eb-4d26-98a6-8475d5f6cba8-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:48 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628" returned: 0 in 1.274s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:48 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628
Apr 13 20:35:48 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:48 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e" returned: 0 in 2.147s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[461f33d3-7907-4932-b491-e3d27b5948c1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:48 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3
Apr 13 20:35:48 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:48 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-615ab210-0069-4a33-9def-9fb56284b628" returned: 0 in 0.402s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-615ab210-0069-4a33-9def-9fb56284b628" released by "delete_volume" :: held 1.716s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created reservations ['e78a4702-454c-4b62-836c-e39729592d13', '3a8a38c7-071f-44bc-a3ab-652dd1e8e6cb', '50d99541-0ba6-4a8a-97b2-1387e87d9256', 'f704f8ef-4d2a-40f3-a551-82126c3e0451'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:48 devstack sudo[90435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:48 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:48 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" returned: 0 in 0.611s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:35:48 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Converted 1024.00 MB image at 476.59 MB/s
Apr 13 20:35:48 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e is being set with open permissions: ugo+rw
Apr 13 20:35:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:48 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e
Apr 13 20:35:48 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:49 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.424s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:49 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Deleted volume successfully.
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-d5d4f3df-ec7c-4270-b8bb-80997e538d5c-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-741c9ced-a67c-4114-84ab-d8faf23a2218 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-615ab210-0069-4a33-9def-9fb56284b628-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-d5d4f3df-ec7c-4270-b8bb-80997e538d5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-quobyte-c85728f5-2bfa-44d7-b933-656698e27589" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-c85728f5-2bfa-44d7-b933-656698e27589" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-quobyte-d5d4f3df-ec7c-4270-b8bb-80997e538d5c" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-d5d4f3df-ec7c-4270-b8bb-80997e538d5c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Deleting offline snapshot d5d4f3df-ec7c-4270-b8bb-80997e538d5c of volume c85728f5-2bfa-44d7-b933-656698e27589 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] snapshot_file for this snap is: volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e5b9ed-8d09-47ae-8082-10094e093ec1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:49 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c
Apr 13 20:35:49 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:49 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e" returned: 0 in 0.444s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-d9d7f9d1-4efd-468a-8b32-a550952aef6e" released by "_copy_volume_from_snapshot" :: held 4.264s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-7252c16b-4e6f-4091-a788-2ef6820172b6-d9d7f9d1-4efd-468a-8b32-a550952aef6e" released by "_create_volume_from_snapshot" :: held 4.280s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.288s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237cecec-509a-4776-930b-b674598d3d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e', 'volume_size': 1, 'snapshot_id': '7252c16b-4e6f-4091-a788-2ef6820172b6'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f764ca5-3004-4a4b-910f-724eb9ba631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:49 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Volume volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e (d9d7f9d1-4efd-468a-8b32-a550952aef6e): created successfully
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f764ca5-3004-4a4b-910f-724eb9ba631a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Flow 'volume_create_manager' (98a10f16-ea86-4fa4-95d5-50aa03171c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:49 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c9a938e6-41f6-4219-9861-9f94e60003f1 tempest-VolumeDependencyTests-1132105655 None] Created volume successfully.
Apr 13 20:35:49 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c" returned: 0 in 0.474s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c85728f5-2bfa-44d7-b933-656698e27589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64b1abd-77a1-4961-8cfc-90867a573481]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:49 devstack sudo[90448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589
Apr 13 20:35:49 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:50 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589" returned: 0 in 0.465s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:50 devstack sudo[90453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c
Apr 13 20:35:50 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-7252c16b-4e6f-4091-a788-2ef6820172b6-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-7252c16b-4e6f-4091-a788-2ef6820172b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-quobyte-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-quobyte-7252c16b-4e6f-4091-a788-2ef6820172b6" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-7252c16b-4e6f-4091-a788-2ef6820172b6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Deleting offline snapshot 7252c16b-4e6f-4091-a788-2ef6820172b6 of volume abce3c3d-bccf-4c18-9d7f-e38bb46846b3 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] snapshot_file for this snap is: volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b516d70-4db3-4a7f-a81a-0a114deb76dc]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:50 devstack sudo[90455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6
Apr 13 20:35:50 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:50 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c" returned: 0 in 0.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:50 devstack sudo[90460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c
Apr 13 20:35:50 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:50 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6" returned: 0 in 0.481s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[514bac76-3aa1-44eb-9490-70a15d20e8d7]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:51 devstack sudo[90465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3
Apr 13 20:35:51 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:51 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589.d5d4f3df-ec7c-4270-b8bb-80997e538d5c" returned: 0 in 0.420s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-d5d4f3df-ec7c-4270-b8bb-80997e538d5c" released by "_delete_snapshot" :: held 1.895s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-c85728f5-2bfa-44d7-b933-656698e27589" released by "delete_snapshot" :: held 1.906s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created reservations ['90427fe9-49f5-4c5b-b0e0-f9c184950fb3', '6d59f15c-ce0f-463b-bab6-db2b6a0065f0', '92308c53-d11a-4fe3-9f04-1572cc658cce', '20e58877-b75e-4fd9-8fcf-eb84c4d8da76'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:51 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Delete snapshot completed successfully.
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-59277b72-d881-4a91-9e4a-4a3ddbb6d78f tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-d5d4f3df-ec7c-4270-b8bb-80997e538d5c-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-c85728f5-2bfa-44d7-b933-656698e27589-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-c85728f5-2bfa-44d7-b933-656698e27589-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "cinder-quobyte-c85728f5-2bfa-44d7-b933-656698e27589" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-c85728f5-2bfa-44d7-b933-656698e27589" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fcb8bc-ceab-4e34-9c2c-cbf86bed3cd7]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:51 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" returned: 0 in 0.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:51 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6
Apr 13 20:35:51 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:51 devstack sudo[90471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589
Apr 13 20:35:51 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:51 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:51 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589" returned: 0 in 0.477s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6" returned: 0 in 0.463s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:51 devstack sudo[90481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589
Apr 13 20:35:51 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:51 devstack sudo[90482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6
Apr 13 20:35:51 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:52 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-c85728f5-2bfa-44d7-b933-656698e27589" returned: 0 in 0.400s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-quobyte-c85728f5-2bfa-44d7-b933-656698e27589" released by "delete_volume" :: held 0.907s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:52 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3.7252c16b-4e6f-4091-a788-2ef6820172b6" returned: 0 in 0.423s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Created reservations ['5ff1ae40-e50d-436a-9280-a12704c9ffa2', '69c547d8-1ea1-44d6-9776-4cf2daded773', '9b36ee86-56b5-477f-92d9-ee20f54b1062', '52f6d9bb-66c1-40bc-b951-a464a1d6551c'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-7252c16b-4e6f-4091-a788-2ef6820172b6" released by "_delete_snapshot" :: held 1.913s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" released by "delete_snapshot" :: held 1.926s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:52 devstack sudo[90487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:52 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Created reservations ['38502bd5-5b06-47e7-b755-cc1d2ec99df1', '2ca34ba4-719e-4b41-8dc6-2425e4a78767', '2bb73f73-fc73-4282-a712-0cc311e8a563', '64cafc65-7b4b-4a74-90e9-707ba11744c6'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:52 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Delete snapshot completed successfully.
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-57e068e4-fbb2-4b78-9706-162d36e2e56e tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-7252c16b-4e6f-4091-a788-2ef6820172b6-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-abce3c3d-bccf-4c18-9d7f-e38bb46846b3-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-abce3c3d-bccf-4c18-9d7f-e38bb46846b3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-quobyte-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" acquired by "delete_volume" :: waited 0.029s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b06f862-b172-46cb-a369-fd8e384c26ca]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:52 devstack sudo[90489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3
Apr 13 20:35:52 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:52 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:52 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Deleted volume successfully.
Apr 13 20:35:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-10c986e0-fd8b-417a-a157-811157481b12 tempest-CreateVolumesFromSnapshotTest-1395849577 None] Lock "cinder-c85728f5-2bfa-44d7-b933-656698e27589-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:53 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" returned: 0 in 0.514s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:53 devstack sudo[90495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3
Apr 13 20:35:53 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:53 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" returned: 0 in 0.428s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:53 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-abce3c3d-bccf-4c18-9d7f-e38bb46846b3" released by "delete_volume" :: held 0.974s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:53 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Created reservations ['ed4d4e7e-9d83-46fa-a06e-b144e1da3313', '0faf2728-7f09-43bf-80fa-5ace6e672b30', '62b9faa6-c102-468b-b3d1-e2a531c40b40', '132b4c5b-aeb5-43f5-bae0-2f5ed01abf4c'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:35:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:53 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:53 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:54 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.395s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:54 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Deleted volume successfully.
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8d32e89c-5dc5-463d-81c4-6632d09d4dca tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-abce3c3d-bccf-4c18-9d7f-e38bb46846b3-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Flow 'volume_create_manager' (c3d84e79-b535-4b75-b82e-83e40699d511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c39258-3429-444c-ae43-00e6dcd5957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c39258-3429-444c-ae43-00e6dcd5957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-247674277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b24b57-9b61-4a89-b09f-41645a22073b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3080270a8e749c0a74f9ac9bd9a25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:55Z,use_quota=True,user_id='2e07287fad91461c8b3e5cf34c2f5bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a95137-24af-4e0b-8219-df3f919340c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a95137-24af-4e0b-8219-df3f919340c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75681964-a128-4d20-9376-8fd36ae1b600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75681964-a128-4d20-9376-8fd36ae1b600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b24b57-9b61-4a89-b09f-41645a22073b', 'volume_name': 'volume-32b24b57-9b61-4a89-b09f-41645a22073b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a62dbe-4073-4d0c-a77b-746e8e143e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a62dbe-4073-4d0c-a77b-746e8e143e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe89a675-f195-4f28-ab2c-e6ba325262e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:55 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Volume 32b24b57-9b61-4a89-b09f-41645a22073b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b24b57-9b61-4a89-b09f-41645a22073b', 'volume_size': 1}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-247674277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b24b57-9b61-4a89-b09f-41645a22073b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3080270a8e749c0a74f9ac9bd9a25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:55Z,use_quota=True,user_id='2e07287fad91461c8b3e5cf34c2f5bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Creating volume 32b24b57-9b61-4a89-b09f-41645a22073b {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:35:55 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:55 devstack sudo[90501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b 1073741824
Apr 13 20:35:55 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:55 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b 1073741824" returned: 0 in 0.469s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:55 devstack sudo[90506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b
Apr 13 20:35:55 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:55 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b" returned: 0 in 0.416s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe89a675-f195-4f28-ab2c-e6ba325262e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b24b57-9b61-4a89-b09f-41645a22073b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68750d4a-608c-4b4f-b6a9-7187827a5542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:55 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Volume volume-32b24b57-9b61-4a89-b09f-41645a22073b (32b24b57-9b61-4a89-b09f-41645a22073b): created successfully
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68750d4a-608c-4b4f-b6a9-7187827a5542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Flow 'volume_create_manager' (c3d84e79-b535-4b75-b82e-83e40699d511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:55 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3d74f6f4-ef35-4302-b96e-55cf2bd9d923 tempest-VolumeDependencyTests-1132105655 None] Created volume successfully.
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Flow 'volume_create_manager' (3c5cc1a6-2f67-4442-bcb9-015d830c8ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc2a1ee-ac5a-44e6-a339-ca8ad787a078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc2a1ee-ac5a-44e6-a339-ca8ad787a078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2118766388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982d6b43-3e77-409d-99b2-4c4ca7b2de78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3080270a8e749c0a74f9ac9bd9a25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=32b24b57-9b61-4a89-b09f-41645a22073b,status='creating',terminated_at=None,updated_at=2026-04-13T18:35:57Z,use_quota=True,user_id='2e07287fad91461c8b3e5cf34c2f5bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692017eb-4211-4f24-bf29-d03223acb57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692017eb-4211-4f24-bf29-d03223acb57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfed00d-e6c7-4fd4-a051-8e1209571366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfed00d-e6c7-4fd4-a051-8e1209571366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '982d6b43-3e77-409d-99b2-4c4ca7b2de78', 'volume_name': 'volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78', 'volume_size': 1, 'source_volid': '32b24b57-9b61-4a89-b09f-41645a22073b', 'source_volstatus': 'available'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b09169-0827-4c73-9d6b-3c48126f42b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b09169-0827-4c73-9d6b-3c48126f42b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63263e6-ec65-4e53-a4d2-1ce27e851625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:35:57 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Volume 982d6b43-3e77-409d-99b2-4c4ca7b2de78: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78', 'volume_size': 1, 'source_volid': '32b24b57-9b61-4a89-b09f-41645a22073b', 'source_volstatus': 'available'}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:57 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Cloning volume 32b24b57-9b61-4a89-b09f-41645a22073b to volume 982d6b43-3e77-409d-99b2-4c4ca7b2de78
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Creating offline snapshot fa35b72a-1676-4530-9b69-4dcf1849547d of volume 32b24b57-9b61-4a89-b09f-41645a22073b {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[293806f3-0da1-40bb-af4a-9997e05e3fd3]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:57 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b
Apr 13 20:35:57 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG oslo_service.periodic_task [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82824) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:57 devstack sudo[90511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:35:57 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:57 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b" returned: 0 in 0.458s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:57 devstack sudo[90516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d 1G
Apr 13 20:35:57 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:58 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.406s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:35:58 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d 1G" returned: 0 in 0.490s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b24b57-9b61-4a89-b09f-41645a22073b -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:58 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b24b57-9b61-4a89-b09f-41645a22073b -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d
Apr 13 20:35:58 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:58 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b24b57-9b61-4a89-b09f-41645a22073b -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d" returned: 0 in 0.409s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:58 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d is being set with open permissions: ugo+rw
Apr 13 20:35:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:58 devstack sudo[90527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d
Apr 13 20:35:58 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:59 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d" returned: 0 in 0.393s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:59 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.info
Apr 13 20:35:59 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:59 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.info" returned: 0 in 0.400s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:59 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.info is being set with open permissions: ugo+rw
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:35:59 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.info
Apr 13 20:35:59 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:35:59 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.info" returned: 0 in 0.395s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-quobyte-982d6b43-3e77-409d-99b2-4c4ca7b2de78" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-982d6b43-3e77-409d-99b2-4c4ca7b2de78" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] snapshot: fa35b72a-1676-4530-9b69-4dcf1849547d, volume: 982d6b43-3e77-409d-99b2-4c4ca7b2de78,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:35:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:00 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89e86ea-fb9f-4d96-b1b5-1163e76bf00e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:00 devstack sudo[90537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d
Apr 13 20:36:00 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:00 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d" returned: 0 in 0.459s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b24b57-9b61-4a89-b09f-41645a22073b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:36:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:36:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:36:00 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b6a5e1-e5e4-4d19-8603-768bb2c1aa60]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:00 devstack sudo[90542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b
Apr 13 20:36:00 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:00 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b" returned: 0 in 0.459s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:00 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78 not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:36:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:00 devstack sudo[90547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78
Apr 13 20:36:00 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:02 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78" returned: 0 in 1.910s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:02 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ba8375-e653-4789-85cc-8ae5ad7e4bc6]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:02 devstack sudo[90559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b
Apr 13 20:36:02 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:03 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b" returned: 0 in 0.599s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78 {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:36:03 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Converted 1024.00 MB image at 535.71 MB/s
Apr 13 20:36:03 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78 is being set with open permissions: ugo+rw
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:03 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78
Apr 13 20:36:03 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:03 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78" returned: 0 in 0.406s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-982d6b43-3e77-409d-99b2-4c4ca7b2de78" released by "_copy_volume_from_snapshot" :: held 3.875s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:UPDATE=180,cinder:SELECT=123,cinder:DELETE=19,cinder:INSERT=38 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-quobyte-fa35b72a-1676-4530-9b69-4dcf1849547d" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-fa35b72a-1676-4530-9b69-4dcf1849547d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Deleting offline snapshot fa35b72a-1676-4530-9b69-4dcf1849547d of volume 32b24b57-9b61-4a89-b09f-41645a22073b {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] snapshot_file for this snap is: volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbd0d99-634a-4cea-9225-b9038a8e8948]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:03 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d
Apr 13 20:36:03 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:04 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d" returned: 0 in 0.458s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b24b57-9b61-4a89-b09f-41645a22073b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:36:04 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0a03f4-25a7-4686-ad54-47d1cc5ecdcd]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:04 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b
Apr 13 20:36:04 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:04 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b" returned: 0 in 0.460s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:04 devstack sudo[90577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d
Apr 13 20:36:04 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:05 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d" returned: 0 in 0.438s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:05 devstack sudo[90582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d
Apr 13 20:36:05 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:05 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b.fa35b72a-1676-4530-9b69-4dcf1849547d" returned: 0 in 0.399s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-fa35b72a-1676-4530-9b69-4dcf1849547d" released by "_delete_snapshot" :: held 1.807s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.337s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:05 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63263e6-ec65-4e53-a4d2-1ce27e851625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78', 'volume_size': 1, 'source_volid': '32b24b57-9b61-4a89-b09f-41645a22073b', 'source_volstatus': 'available'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:05 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446b1f6d-6782-4b2a-82b3-b02d4c4aaff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:05 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Volume volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78 (982d6b43-3e77-409d-99b2-4c4ca7b2de78): created successfully
Apr 13 20:36:05 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446b1f6d-6782-4b2a-82b3-b02d4c4aaff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:05 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Flow 'volume_create_manager' (3c5cc1a6-2f67-4442-bcb9-015d830c8ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:05 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5015588a-f00c-40d1-a8e1-98d286e2f3c0 tempest-VolumeDependencyTests-1132105655 None] Created volume successfully.
Apr 13 20:36:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-32b24b57-9b61-4a89-b09f-41645a22073b-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-32b24b57-9b61-4a89-b09f-41645a22073b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-quobyte-32b24b57-9b61-4a89-b09f-41645a22073b" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-32b24b57-9b61-4a89-b09f-41645a22073b" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:06 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d149e56-a547-4544-bd96-86360ffb51a3]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:06 devstack sudo[90585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b
Apr 13 20:36:06 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:07 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b" returned: 0 in 0.473s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:07 devstack sudo[90590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b
Apr 13 20:36:07 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:07 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-32b24b57-9b61-4a89-b09f-41645a22073b" returned: 0 in 0.404s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-32b24b57-9b61-4a89-b09f-41645a22073b" released by "delete_volume" :: held 0.912s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Created reservations ['38a6f6f3-5dab-4c35-8ed0-d8f879af4099', 'ec4a309d-5ea8-45b1-b775-72823dc6bf55', '086f8fb2-bf85-47ff-8e47-2ffb31a1ae84', 'ada32840-9f55-4af7-a083-2d1d94c5d412'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:07 devstack sudo[90593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:07 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-982d6b43-3e77-409d-99b2-4c4ca7b2de78-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-982d6b43-3e77-409d-99b2-4c4ca7b2de78-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-quobyte-982d6b43-3e77-409d-99b2-4c4ca7b2de78" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-982d6b43-3e77-409d-99b2-4c4ca7b2de78" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaed4255-dd25-441b-956c-b09eb505aa3f]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:08 devstack sudo[90595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78
Apr 13 20:36:08 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:08 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.432s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:08 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Deleted volume successfully.
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c5c127c7-c7fa-4414-a885-66557cdd7bdf tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-32b24b57-9b61-4a89-b09f-41645a22073b-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:08 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78" returned: 0 in 0.477s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:08 devstack sudo[90601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78
Apr 13 20:36:08 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:08 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-982d6b43-3e77-409d-99b2-4c4ca7b2de78" returned: 0 in 0.413s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-982d6b43-3e77-409d-99b2-4c4ca7b2de78" released by "delete_volume" :: held 0.910s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Created reservations ['f2ea4133-58e8-41fd-9bfc-711f28e4fc7e', 'b1e34235-5641-4282-931c-e88ddd38d956', 'b765e365-bf44-456e-84c9-24e197c904e8', '86eb7fe2-6ee6-4933-902a-b9a328d1b938'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:08 devstack sudo[90604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:08 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-d9d7f9d1-4efd-468a-8b32-a550952aef6e-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-d9d7f9d1-4efd-468a-8b32-a550952aef6e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "cinder-quobyte-d9d7f9d1-4efd-468a-8b32-a550952aef6e" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-d9d7f9d1-4efd-468a-8b32-a550952aef6e" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:09 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ef6411-a768-471b-8623-74c32535c4a0]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:09 devstack sudo[90606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e
Apr 13 20:36:09 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:09 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.433s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:09 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:09 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Deleted volume successfully.
Apr 13 20:36:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4f8bf5fa-9e83-4256-9b2a-7d4b045d7afb tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-982d6b43-3e77-409d-99b2-4c4ca7b2de78-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:09 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e" returned: 0 in 0.480s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:09 devstack sudo[90613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e
Apr 13 20:36:09 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:10 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-d9d7f9d1-4efd-468a-8b32-a550952aef6e" returned: 0 in 0.415s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-quobyte-d9d7f9d1-4efd-468a-8b32-a550952aef6e" released by "delete_volume" :: held 0.928s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Created reservations ['61296361-897e-471c-b1d3-03d7e2ed6734', '96919e30-59f3-428f-a291-b6bc18f9b677', '4f8548a3-a69f-4337-a9a8-3e1e20bfa8bc', '979de730-b3e2-4744-a95a-b322277d0fba'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:10 devstack sudo[90616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:10 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:10 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.449s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:10 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Deleted volume successfully.
Apr 13 20:36:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-891a133f-d65a-4500-baf5-7c17d3148c84 tempest-VolumeDependencyTests-1132105655 None] Lock "cinder-d9d7f9d1-4efd-468a-8b32-a550952aef6e-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Flow 'volume_create_manager' (0b77bea0-54fb-4f31-aeae-22aa84e7fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcc372a-1d88-482b-bb51-443eb921c26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcc372a-1d88-482b-bb51-443eb921c26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2061548285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2edfbe-bb5c-4c03-8127-91254be1b71c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef5c675659d4c03bd7e78bbdd86e18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:17Z,use_quota=True,user_id='9818a21200214e8cb0d69c613b32aade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51512470-1d91-4364-bc06-373810473ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51512470-1d91-4364-bc06-373810473ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a6a051-5f2d-4719-8b91-f14e940656ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a6a051-5f2d-4719-8b91-f14e940656ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2edfbe-bb5c-4c03-8127-91254be1b71c', 'volume_name': 'volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb33a53c-fa97-459e-8853-02ec5c5639e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb33a53c-fa97-459e-8853-02ec5c5639e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69da0614-bf61-42a4-bc9b-c73c9d53515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Volume 8c2edfbe-bb5c-4c03-8127-91254be1b71c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c', 'volume_size': 1}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2061548285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2edfbe-bb5c-4c03-8127-91254be1b71c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef5c675659d4c03bd7e78bbdd86e18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:17Z,use_quota=True,user_id='9818a21200214e8cb0d69c613b32aade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Creating volume 8c2edfbe-bb5c-4c03-8127-91254be1b71c {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:17 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:17 devstack sudo[90699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c 1073741824
Apr 13 20:36:17 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Flow 'volume_create_manager' (e14cb519-3b1c-4514-b53d-514daa9b970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a2b186-1ed0-4eba-a463-10bfd7a170bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a2b186-1ed0-4eba-a463-10bfd7a170bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-822309012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948af6bf-64b5-4f03-b28a-8c76558aea08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af411be7bb0548b68ebcaa18753cfe21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:17Z,use_quota=True,user_id='b015c857a47b49079b21780803d81890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76654b84-9471-47da-87ff-f1d68b24dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76654b84-9471-47da-87ff-f1d68b24dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1fe75a-d758-4789-b54b-bb1b9ae76988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1fe75a-d758-4789-b54b-bb1b9ae76988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '948af6bf-64b5-4f03-b28a-8c76558aea08', 'volume_name': 'volume-948af6bf-64b5-4f03-b28a-8c76558aea08', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9e73c4-dcb9-4fc0-9aa1-f8d78ef5d2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9e73c4-dcb9-4fc0-9aa1-f8d78ef5d2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44154014-debb-470b-b3fb-99fc94bb1fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Volume 948af6bf-64b5-4f03-b28a-8c76558aea08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-948af6bf-64b5-4f03-b28a-8c76558aea08', 'volume_size': 1}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (eeedfcb6-c261-4311-9b4f-14885d804363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4d7639-59e3-4087-8322-39cc9cae0648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4d7639-59e3-4087-8322-39cc9cae0648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1283292880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193fcbd7-3074-446b-aceb-c07023fbe117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:18Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e62783d-62e8-4a22-80e6-454b38b34720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e62783d-62e8-4a22-80e6-454b38b34720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc85c7cc-6264-442a-a0c4-34fe3afc3eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc85c7cc-6264-442a-a0c4-34fe3afc3eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '193fcbd7-3074-446b-aceb-c07023fbe117', 'volume_name': 'volume-193fcbd7-3074-446b-aceb-c07023fbe117', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337574c3-eaf7-4486-b64e-44e8999f7ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337574c3-eaf7-4486-b64e-44e8999f7ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263f1d33-ebc3-4d08-9014-e6a8a5efedd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume 193fcbd7-3074-446b-aceb-c07023fbe117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-193fcbd7-3074-446b-aceb-c07023fbe117', 'volume_size': 1}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Flow 'volume_create_manager' (f307c7e4-9515-44aa-a065-e59aeb8e7634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2bc29c-6375-42b3-892c-a352936a4a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2bc29c-6375-42b3-892c-a352936a4a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-42365727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7867863-226d-43f8-8c6f-a6b21eddd7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef5c675659d4c03bd7e78bbdd86e18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:18Z,use_quota=True,user_id='9818a21200214e8cb0d69c613b32aade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae86944-6a17-489d-9329-243f4792f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae86944-6a17-489d-9329-243f4792f365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ef598b-457d-46a8-8e80-79eb9b42ef12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ef598b-457d-46a8-8e80-79eb9b42ef12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7867863-226d-43f8-8c6f-a6b21eddd7ed', 'volume_name': 'volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ede8832-e158-4016-9ca1-15e101fef22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ede8832-e158-4016-9ca1-15e101fef22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07f7947-5a8d-44d1-a34e-58a6ff0357da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:17 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Volume f7867863-226d-43f8-8c6f-a6b21eddd7ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed', 'volume_size': 1}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:17 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Flow 'volume_create_manager' (8f1552ad-8e6b-4149-9a39-cfc70214e4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c55db0-e05c-45ca-b6f0-2a464e685677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c55db0-e05c-45ca-b6f0-2a464e685677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208412476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41144db7-b9f6-47ca-a0c6-9ec029661bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef5c675659d4c03bd7e78bbdd86e18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:18Z,use_quota=True,user_id='9818a21200214e8cb0d69c613b32aade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b9031c-af76-4666-abd1-128155c2d593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b9031c-af76-4666-abd1-128155c2d593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bff04f-a539-4cbe-bfb8-a9d0d16574de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bff04f-a539-4cbe-bfb8-a9d0d16574de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41144db7-b9f6-47ca-a0c6-9ec029661bc9', 'volume_name': 'volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e926cf64-1854-4949-a73f-b4110927f424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e926cf64-1854-4949-a73f-b4110927f424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15847d2d-6b6a-49ed-89ff-bbe9d59f94d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Volume 41144db7-b9f6-47ca-a0c6-9ec029661bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9', 'volume_size': 1}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:18 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c 1073741824" returned: 0 in 0.816s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Flow 'volume_create_manager' (f8a4dd7a-a0d8-47b5-96e8-a8d21816a2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d215f4b1-5332-4f60-828d-d74c23b839ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d215f4b1-5332-4f60-828d-d74c23b839ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272984290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39289119-b25a-4b2e-8c3a-bd9974020dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef5c675659d4c03bd7e78bbdd86e18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:18Z,use_quota=True,user_id='9818a21200214e8cb0d69c613b32aade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533934cc-0c25-4602-8a71-400070f15fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533934cc-0c25-4602-8a71-400070f15fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a18e18-dae3-4e16-9840-248a87397f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a18e18-dae3-4e16-9840-248a87397f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39289119-b25a-4b2e-8c3a-bd9974020dc1', 'volume_name': 'volume-39289119-b25a-4b2e-8c3a-bd9974020dc1', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d37f430-8c8b-45e9-8f80-1d86d7358cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d37f430-8c8b-45e9-8f80-1d86d7358cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75964e9e-d5b0-46ee-9c70-98d70423577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Volume 39289119-b25a-4b2e-8c3a-bd9974020dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39289119-b25a-4b2e-8c3a-bd9974020dc1', 'volume_size': 1}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:18 devstack sudo[90704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c
Apr 13 20:36:18 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=138,cinder:UPDATE=173,cinder:INSERT=50,cinder:DELETE=9 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Flow 'volume_create_manager' (8bc4b5f6-bd0b-4c3b-a8c5-4b139d99c9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4f0213-7fce-4d0c-a855-08142d404d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4f0213-7fce-4d0c-a855-08142d404d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055954783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf57dea3-5d41-49ef-a64e-c42493c1207c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef5c675659d4c03bd7e78bbdd86e18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:18Z,use_quota=True,user_id='9818a21200214e8cb0d69c613b32aade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6fadfc-3917-4ddf-a700-b6c479af9672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6fadfc-3917-4ddf-a700-b6c479af9672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da0583c-2a7a-4952-b3d6-882ac44f7dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da0583c-2a7a-4952-b3d6-882ac44f7dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf57dea3-5d41-49ef-a64e-c42493c1207c', 'volume_name': 'volume-bf57dea3-5d41-49ef-a64e-c42493c1207c', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3864c409-5cae-4e17-ad88-8daa8fa1a391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3864c409-5cae-4e17-ad88-8daa8fa1a391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a38cd3-1638-4efc-ab7c-5f1e03cb8db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Volume bf57dea3-5d41-49ef-a64e-c42493c1207c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf57dea3-5d41-49ef-a64e-c42493c1207c', 'volume_size': 1}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:18 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c" returned: 0 in 0.512s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.215s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-822309012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948af6bf-64b5-4f03-b28a-8c76558aea08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af411be7bb0548b68ebcaa18753cfe21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:17Z,use_quota=True,user_id='b015c857a47b49079b21780803d81890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Creating volume 948af6bf-64b5-4f03-b28a-8c76558aea08 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:18 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69da0614-bf61-42a4-bc9b-c73c9d53515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9809103-5cf6-4a4d-bfcf-e66538d913f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:18 devstack sudo[90707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 1073741824
Apr 13 20:36:18 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:18 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Volume volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c (8c2edfbe-bb5c-4c03-8127-91254be1b71c): created successfully
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9809103-5cf6-4a4d-bfcf-e66538d913f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:18 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Flow 'volume_create_manager' (0b77bea0-54fb-4f31-aeae-22aa84e7fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:18 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-429c094d-acbe-49e1-a2b8-7f4808be76bb tempest-CreateVolumesFromImageTest-825669753 None] Created volume successfully.
Apr 13 20:36:19 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 1073741824" returned: 0 in 0.520s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:19 devstack sudo[90712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08
Apr 13 20:36:19 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:19 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08" returned: 0 in 0.497s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.075s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1283292880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193fcbd7-3074-446b-aceb-c07023fbe117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:18Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Creating volume 193fcbd7-3074-446b-aceb-c07023fbe117 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:19 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44154014-debb-470b-b3fb-99fc94bb1fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-948af6bf-64b5-4f03-b28a-8c76558aea08', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2febf501-16f6-4d14-9383-89393117901e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:19 devstack sudo[90716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117 1073741824
Apr 13 20:36:19 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:19 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Volume volume-948af6bf-64b5-4f03-b28a-8c76558aea08 (948af6bf-64b5-4f03-b28a-8c76558aea08): created successfully
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2febf501-16f6-4d14-9383-89393117901e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:19 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Flow 'volume_create_manager' (e14cb519-3b1c-4514-b53d-514daa9b970b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:19 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-578e038a-3ff5-4396-87f1-5eed457a4304 tempest-VolumeDependencyTests-541334121 None] Created volume successfully.
Apr 13 20:36:20 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117 1073741824" returned: 0 in 0.575s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:20 devstack sudo[90721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117
Apr 13 20:36:20 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:20 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117" returned: 0 in 0.430s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.007s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-42365727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7867863-226d-43f8-8c6f-a6b21eddd7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef5c675659d4c03bd7e78bbdd86e18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:18Z,use_quota=True,user_id='9818a21200214e8cb0d69c613b32aade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Creating volume f7867863-226d-43f8-8c6f-a6b21eddd7ed {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:20 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263f1d33-ebc3-4d08-9014-e6a8a5efedd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193fcbd7-3074-446b-aceb-c07023fbe117', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:20 devstack sudo[90724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed 1073741824
Apr 13 20:36:20 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17bea52-e11d-41b3-858c-f17fde972472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:20 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume volume-193fcbd7-3074-446b-aceb-c07023fbe117 (193fcbd7-3074-446b-aceb-c07023fbe117): created successfully
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17bea52-e11d-41b3-858c-f17fde972472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:20 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (eeedfcb6-c261-4311-9b4f-14885d804363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:20 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-dc4daeda-4f8d-4f97-ae43-f0d0caba5a35 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created volume successfully.
Apr 13 20:36:21 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed 1073741824" returned: 0 in 0.517s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:21 devstack sudo[90729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed
Apr 13 20:36:21 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:21 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed" returned: 0 in 0.456s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.760s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208412476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41144db7-b9f6-47ca-a0c6-9ec029661bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef5c675659d4c03bd7e78bbdd86e18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:18Z,use_quota=True,user_id='9818a21200214e8cb0d69c613b32aade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Creating volume 41144db7-b9f6-47ca-a0c6-9ec029661bc9 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:21 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07f7947-5a8d-44d1-a34e-58a6ff0357da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d686178-b9f5-463f-992c-78b64f588f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:21 devstack sudo[90732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9 1073741824
Apr 13 20:36:21 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:21 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Volume volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed (f7867863-226d-43f8-8c6f-a6b21eddd7ed): created successfully
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d686178-b9f5-463f-992c-78b64f588f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:21 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Flow 'volume_create_manager' (f307c7e4-9515-44aa-a065-e59aeb8e7634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:21 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-543fa2cf-001d-4754-aed9-d3f8e50299fc tempest-CreateVolumesFromImageTest-825669753 None] Created volume successfully.
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (62b29601-c8ef-44e1-8509-51c7da99413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d175191-a55c-4cd9-9ca1-938818fb01de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d175191-a55c-4cd9-9ca1-938818fb01de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2107857109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:22Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b768a07f-98ba-47ce-9a5d-422fe4c7d8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b768a07f-98ba-47ce-9a5d-422fe4c7d8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12047a2c-69de-4634-b0d8-d94f6f6f4364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12047a2c-69de-4634-b0d8-d94f6f6f4364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5', 'volume_name': 'volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b42ed9-686c-4c8d-b360-fc4483f7053d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b42ed9-686c-4c8d-b360-fc4483f7053d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035f0b15-d3b1-4b4d-a5b7-8947ff4d173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume 4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5', 'volume_size': 1}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (4c1e4cd2-4f1b-49ce-8716-3abaa338409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefbd680-1f6e-4d4b-8826-e337328316a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefbd680-1f6e-4d4b-8826-e337328316a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2037915917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acdc7b5b-fc32-4b48-907d-03d0ccc16281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:22Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814b0d2f-f156-4d41-9c5d-143484851a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814b0d2f-f156-4d41-9c5d-143484851a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7daf6bd0-aab2-4b7f-b877-a5115a8578b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7daf6bd0-aab2-4b7f-b877-a5115a8578b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acdc7b5b-fc32-4b48-907d-03d0ccc16281', 'volume_name': 'volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b996f69-5aca-4940-82f9-8bd19291cad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b996f69-5aca-4940-82f9-8bd19291cad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb15cd86-74b9-4764-a97b-55ba210fbc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume acdc7b5b-fc32-4b48-907d-03d0ccc16281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281', 'volume_size': 1}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (1b235224-1e1e-44cd-9901-1655dea3fcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9063df5c-9878-46f0-ba89-72a6732b5001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9063df5c-9878-46f0-ba89-72a6732b5001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1028765177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a37ba0f-146a-4a84-8009-6016719dedd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:22Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0570e1-3a86-44e3-959b-2c3daa79b79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0570e1-3a86-44e3-959b-2c3daa79b79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33058ae-8121-49c1-b692-d0fd6d8b2592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33058ae-8121-49c1-b692-d0fd6d8b2592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a37ba0f-146a-4a84-8009-6016719dedd9', 'volume_name': 'volume-7a37ba0f-146a-4a84-8009-6016719dedd9', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c597b8d-8b02-403e-91c7-c262c9d85952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c597b8d-8b02-403e-91c7-c262c9d85952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1dbced5-e282-4442-8a96-2f09ab16c264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume 7a37ba0f-146a-4a84-8009-6016719dedd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a37ba0f-146a-4a84-8009-6016719dedd9', 'volume_size': 1}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:22 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9 1073741824" returned: 0 in 0.702s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:22 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9
Apr 13 20:36:22 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (997b8408-d01f-40eb-aab9-861f28419cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0489978d-1516-4cc3-84ee-9518ff571162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0489978d-1516-4cc3-84ee-9518ff571162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392869240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:23Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0277196c-2f36-4a30-a25d-d94afc915d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0277196c-2f36-4a30-a25d-d94afc915d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfb2344-8032-42a6-ac34-b5ee344d52c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfb2344-8032-42a6-ac34-b5ee344d52c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1', 'volume_name': 'volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c15fba-7a8e-4295-ab57-f9bab14e03b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c15fba-7a8e-4295-ab57-f9bab14e03b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78769e08-1cbd-4435-b2e4-6c5b3662680d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:22 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume 1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1', 'volume_size': 1}
Apr 13 20:36:22 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (46b64bd6-90b6-4807-9a3d-14d26a7e4691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454f2ba7-b7db-4595-bb80-43272b8381ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454f2ba7-b7db-4595-bb80-43272b8381ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-536614660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779b0ef0-6332-4b99-9f89-7bef8345653b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:23Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd24a6e-7127-429b-a0db-270943989487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd24a6e-7127-429b-a0db-270943989487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d70b70-3d96-44a6-b249-2053e17b4261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d70b70-3d96-44a6-b249-2053e17b4261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779b0ef0-6332-4b99-9f89-7bef8345653b', 'volume_name': 'volume-779b0ef0-6332-4b99-9f89-7bef8345653b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0914da2-e4a2-46bc-b1f4-5cbbc745c6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0914da2-e4a2-46bc-b1f4-5cbbc745c6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87ca55a-aa3c-4cae-a2bc-f8bbfc2f5674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:23 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume 779b0ef0-6332-4b99-9f89-7bef8345653b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779b0ef0-6332-4b99-9f89-7bef8345653b', 'volume_size': 1}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:23 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9" returned: 0 in 0.489s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.860s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272984290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39289119-b25a-4b2e-8c3a-bd9974020dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef5c675659d4c03bd7e78bbdd86e18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:18Z,use_quota=True,user_id='9818a21200214e8cb0d69c613b32aade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Creating volume 39289119-b25a-4b2e-8c3a-bd9974020dc1 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:23 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15847d2d-6b6a-49ed-89ff-bbe9d59f94d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28c6fb6-3cad-4ae6-9d78-5c115b1fe452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:23 devstack sudo[90740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1 1073741824
Apr 13 20:36:23 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:23 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Volume volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9 (41144db7-b9f6-47ca-a0c6-9ec029661bc9): created successfully
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28c6fb6-3cad-4ae6-9d78-5c115b1fe452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Flow 'volume_create_manager' (8f1552ad-8e6b-4149-9a39-cfc70214e4c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:23 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-e3069721-4c3b-4528-90bc-58b0bb4bce34 tempest-CreateVolumesFromImageTest-825669753 None] Created volume successfully.
Apr 13 20:36:23 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1 1073741824" returned: 0 in 0.554s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:23 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:23 devstack sudo[90745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1
Apr 13 20:36:23 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:24 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1" returned: 0 in 0.460s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.673s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055954783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf57dea3-5d41-49ef-a64e-c42493c1207c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef5c675659d4c03bd7e78bbdd86e18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:18Z,use_quota=True,user_id='9818a21200214e8cb0d69c613b32aade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Creating volume bf57dea3-5d41-49ef-a64e-c42493c1207c {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:24 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75964e9e-d5b0-46ee-9c70-98d70423577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39289119-b25a-4b2e-8c3a-bd9974020dc1', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20925f11-cde3-4252-848a-dcbacbf2030d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:24 devstack sudo[90748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c 1073741824
Apr 13 20:36:24 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:24 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Volume volume-39289119-b25a-4b2e-8c3a-bd9974020dc1 (39289119-b25a-4b2e-8c3a-bd9974020dc1): created successfully
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20925f11-cde3-4252-848a-dcbacbf2030d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Flow 'volume_create_manager' (f8a4dd7a-a0d8-47b5-96e8-a8d21816a2da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:24 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5dce5055-b4d0-4e60-9c6b-d2fabf8b64c5 tempest-CreateVolumesFromImageTest-825669753 None] Created volume successfully.
Apr 13 20:36:24 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c 1073741824" returned: 0 in 0.522s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:24 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:24 devstack sudo[90753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c
Apr 13 20:36:24 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:25 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c" returned: 0 in 0.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.387s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a38cd3-1638-4efc-ab7c-5f1e03cb8db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf57dea3-5d41-49ef-a64e-c42493c1207c', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32093e05-4c99-4a16-a0bd-8f243f22550c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] Creating offline snapshot 350236f4-1f14-4ec6-83e4-b8468d6a4aee of volume 948af6bf-64b5-4f03-b28a-8c76558aea08 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:36:25 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Volume volume-bf57dea3-5d41-49ef-a64e-c42493c1207c (bf57dea3-5d41-49ef-a64e-c42493c1207c): created successfully
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32093e05-4c99-4a16-a0bd-8f243f22550c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Flow 'volume_create_manager' (8bc4b5f6-bd0b-4c3b-a8c5-4b139d99c9a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[32973680-24f5-47d3-a620-87cb6ef0d302]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:25 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-adc7c230-aa72-495e-8e80-144b17365338 tempest-CreateVolumesFromImageTest-825669753 None] Created volume successfully.
Apr 13 20:36:25 devstack sudo[90756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08
Apr 13 20:36:25 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:25 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08" returned: 0 in 0.515s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:25 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:25 devstack sudo[90761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee 1G
Apr 13 20:36:25 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "cinder-bf57dea3-5d41-49ef-a64e-c42493c1207c-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-bf57dea3-5d41-49ef-a64e-c42493c1207c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "cinder-quobyte-bf57dea3-5d41-49ef-a64e-c42493c1207c" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-quobyte-bf57dea3-5d41-49ef-a64e-c42493c1207c" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e592dc-531d-478b-adfe-ab8f411ceb55]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:26 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c
Apr 13 20:36:26 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:26 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee 1G" returned: 0 in 0.748s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-948af6bf-64b5-4f03-b28a-8c76558aea08 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:26 devstack sudo[90768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-948af6bf-64b5-4f03-b28a-8c76558aea08 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee
Apr 13 20:36:26 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:26 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c" returned: 0 in 0.645s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:26 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c
Apr 13 20:36:26 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:26 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-948af6bf-64b5-4f03-b28a-8c76558aea08 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee" returned: 0 in 0.480s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:26 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee is being set with open permissions: ugo+rw
Apr 13 20:36:26 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:26 devstack sudo[90778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee
Apr 13 20:36:26 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:27 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-bf57dea3-5d41-49ef-a64e-c42493c1207c" returned: 0 in 0.513s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-quobyte-bf57dea3-5d41-49ef-a64e-c42493c1207c" released by "delete_volume" :: held 1.188s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Created reservations ['85548498-2dab-4cdb-bdcb-ec70da538c95', '072fa3e3-5a47-4bfd-9e8e-ce299ab9d71f', 'be51bd57-a8c0-44fa-a9f4-c4fbaea550de', 'aae815ac-c0fe-4791-8938-89e440fa652c'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:27 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee" returned: 0 in 0.446s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:27 devstack sudo[90782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.info
Apr 13 20:36:27 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:27 devstack sudo[90784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:27 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:27 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.440s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:27 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Deleted volume successfully.
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-58caf894-6724-4784-b33b-62b3ad26b432 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-bf57dea3-5d41-49ef-a64e-c42493c1207c-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:27 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.info" returned: 0 in 0.511s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:27 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.info is being set with open permissions: ugo+rw
Apr 13 20:36:27 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:27 devstack sudo[90788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.info
Apr 13 20:36:27 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "cinder-39289119-b25a-4b2e-8c3a-bd9974020dc1-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-39289119-b25a-4b2e-8c3a-bd9974020dc1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "cinder-quobyte-39289119-b25a-4b2e-8c3a-bd9974020dc1" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-quobyte-39289119-b25a-4b2e-8c3a-bd9974020dc1" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:28 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.info" returned: 0 in 0.492s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.275s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[f878dd97-2b27-424b-a298-37876dbeb378]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.374s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2107857109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:22Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Creating volume 4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:28 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:28 devstack sudo[90791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5 1073741824
Apr 13 20:36:28 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:28 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2fa27980-7e58-4d83-9810-df194d76b6df tempest-VolumeDependencyTests-541334121 None] Create snapshot completed successfully
Apr 13 20:36:28 devstack sudo[90792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1
Apr 13 20:36:28 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:28 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:28 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5 1073741824" returned: 0 in 0.511s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:29 devstack sudo[90799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5
Apr 13 20:36:29 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:29 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1" returned: 0 in 0.679s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:29 devstack sudo[90803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1
Apr 13 20:36:29 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Flow 'volume_create_manager' (9c21d784-750e-4c08-8e52-fa281eb7abc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd2a94-f387-41ec-90ca-a519c62b7e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd2a94-f387-41ec-90ca-a519c62b7e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1489696005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4aa16e5-0e13-455e-b0e7-1d53752f7ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af411be7bb0548b68ebcaa18753cfe21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=350236f4-1f14-4ec6-83e4-b8468d6a4aee,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:29Z,use_quota=True,user_id='b015c857a47b49079b21780803d81890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46e4980-ecf9-4fbf-971a-43c3d5840d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46e4980-ecf9-4fbf-971a-43c3d5840d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc956e5b-54d2-454d-a4fd-6b15808a7bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc956e5b-54d2-454d-a4fd-6b15808a7bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b4aa16e5-0e13-455e-b0e7-1d53752f7ee8', 'volume_name': 'volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8', 'volume_size': 1, 'snapshot_id': '350236f4-1f14-4ec6-83e4-b8468d6a4aee'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6d3922-14f9-4326-9516-22791f72e36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6d3922-14f9-4326-9516-22791f72e36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ac989b-b345-4a7e-a538-2522802c7f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:29 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Volume b4aa16e5-0e13-455e-b0e7-1d53752f7ee8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8', 'volume_size': 1, 'snapshot_id': '350236f4-1f14-4ec6-83e4-b8468d6a4aee'}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:29 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5" returned: 0 in 0.605s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.260s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2037915917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acdc7b5b-fc32-4b48-907d-03d0ccc16281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:22Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Creating volume acdc7b5b-fc32-4b48-907d-03d0ccc16281 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:29 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035f0b15-d3b1-4b4d-a5b7-8947ff4d173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02aa0be-4cd5-403c-9ad5-9775a18c7d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:29 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5 (4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5): created successfully
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02aa0be-4cd5-403c-9ad5-9775a18c7d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (62b29601-c8ef-44e1-8509-51c7da99413e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:29 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-177e7cb9-795c-400f-b2df-4627e2c59099 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created volume successfully.
Apr 13 20:36:29 devstack sudo[90808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281 1073741824
Apr 13 20:36:29 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:29 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-39289119-b25a-4b2e-8c3a-bd9974020dc1" returned: 0 in 0.612s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-quobyte-39289119-b25a-4b2e-8c3a-bd9974020dc1" released by "delete_volume" :: held 1.352s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Created reservations ['3d0f3cfe-f69c-4559-ba50-9fa48458cd07', 'a66f3de1-db1a-4470-86d9-5a16f5477ce9', '8cf90563-fd94-439b-a4c2-a18113e90707', 'e60e914e-4bbd-4067-9f52-4eb66b748f87'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:29 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:29 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:29 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:30 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281 1073741824" returned: 0 in 0.549s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:30 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281
Apr 13 20:36:30 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:30 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:30 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Deleted volume successfully.
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-50265a3a-24c9-4a50-8abe-441b1b406d5b tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-39289119-b25a-4b2e-8c3a-bd9974020dc1-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "cinder-41144db7-b9f6-47ca-a0c6-9ec029661bc9-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-41144db7-b9f6-47ca-a0c6-9ec029661bc9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "cinder-quobyte-41144db7-b9f6-47ca-a0c6-9ec029661bc9" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-quobyte-41144db7-b9f6-47ca-a0c6-9ec029661bc9" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3960f55-bd25-48b9-b289-dc2527b48d8f]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:30 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.140s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1028765177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a37ba0f-146a-4a84-8009-6016719dedd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:22Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Creating volume 7a37ba0f-146a-4a84-8009-6016719dedd9 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:30 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb15cd86-74b9-4764-a97b-55ba210fbc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3984588-11d1-4249-aa42-e97a6822092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:30 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281 (acdc7b5b-fc32-4b48-907d-03d0ccc16281): created successfully
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3984588-11d1-4249-aa42-e97a6822092f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:30 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (4c1e4cd2-4f1b-49ce-8716-3abaa338409a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:30 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-9102f48f-01a1-426b-bd4a-76b00c9bcfff tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created volume successfully.
Apr 13 20:36:30 devstack sudo[90821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9 1073741824
Apr 13 20:36:30 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:30 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9
Apr 13 20:36:30 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:31 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9" returned: 0 in 0.570s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:31 devstack sudo[90830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9
Apr 13 20:36:31 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:31 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9 1073741824" returned: 0 in 0.650s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Flow 'volume_create_manager' (7707d8a9-a555-46ba-8420-7a0094640f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015620f8-73b4-4ff6-95ea-db1914a018d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015620f8-73b4-4ff6-95ea-db1914a018d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1998150172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f75ff4-6372-4867-880b-7283eb6eca15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60729cc23a34e919cae2c6143dee2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:31Z,use_quota=True,user_id='9cfcacf444f24a4ea04b0950d6b7fddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc129dc2-7ce5-40cc-911d-e4332a7151dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc129dc2-7ce5-40cc-911d-e4332a7151dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4d568d-90ea-4765-b469-36246ad970c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4d568d-90ea-4765-b469-36246ad970c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f75ff4-6372-4867-880b-7283eb6eca15', 'volume_name': 'volume-61f75ff4-6372-4867-880b-7283eb6eca15', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a6b54c-9d00-44f3-b880-2c78570191f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a6b54c-9d00-44f3-b880-2c78570191f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165e6a43-5486-4eed-b1b9-cc853adc7b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:31 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Volume 61f75ff4-6372-4867-880b-7283eb6eca15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f75ff4-6372-4867-880b-7283eb6eca15', 'volume_size': 1}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:31 devstack sudo[90832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9
Apr 13 20:36:31 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:31 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-41144db7-b9f6-47ca-a0c6-9ec029661bc9" returned: 0 in 0.463s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-quobyte-41144db7-b9f6-47ca-a0c6-9ec029661bc9" released by "delete_volume" :: held 1.064s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Created reservations ['ba32034f-23d5-47a0-b679-419ede2f99ca', '4ec21ce3-2845-4bfa-a247-7928751c9b12', '523b523a-6402-4ea2-93f4-62451d8511dd', 'f2a7cfec-3043-4b56-be0f-4702f092b733'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:31 devstack sudo[90835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:31 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:31 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9" returned: 0 in 0.428s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.039s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392869240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:23Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Creating volume 1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:31 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1dbced5-e282-4442-8a96-2f09ab16c264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a37ba0f-146a-4a84-8009-6016719dedd9', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:31 devstack sudo[90838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1 1073741824
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675cbc11-e8ab-418f-bb36-85728a064fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:31 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:31 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume volume-7a37ba0f-146a-4a84-8009-6016719dedd9 (7a37ba0f-146a-4a84-8009-6016719dedd9): created successfully
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675cbc11-e8ab-418f-bb36-85728a064fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:31 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (1b235224-1e1e-44cd-9901-1655dea3fcca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:31 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-97f40c88-cb3f-454f-910f-e42664f4aa53 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created volume successfully.
Apr 13 20:36:32 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.449s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:32 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Deleted volume successfully.
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-6151cc97-c693-4c75-96fb-36985ba8aef3 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-41144db7-b9f6-47ca-a0c6-9ec029661bc9-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:32 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1 1073741824" returned: 0 in 0.536s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:32 devstack sudo[90844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1
Apr 13 20:36:32 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "cinder-f7867863-226d-43f8-8c6f-a6b21eddd7ed-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-f7867863-226d-43f8-8c6f-a6b21eddd7ed-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "cinder-quobyte-f7867863-226d-43f8-8c6f-a6b21eddd7ed" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-quobyte-f7867863-226d-43f8-8c6f-a6b21eddd7ed" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d88a82e-e46e-4924-9093-d363239155b8]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:32 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1" returned: 0 in 0.453s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.818s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-536614660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779b0ef0-6332-4b99-9f89-7bef8345653b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a44295ae65144f3846e8c91c2bc7fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:23Z,use_quota=True,user_id='009ae65f08434e289f94ab2247a380a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Creating volume 779b0ef0-6332-4b99-9f89-7bef8345653b {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:32 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:32 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed
Apr 13 20:36:32 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78769e08-1cbd-4435-b2e4-6c5b3662680d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:32 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b 1073741824
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8224aa-3434-4054-9ae7-94670f515bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:32 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:32 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1 (1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1): created successfully
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8224aa-3434-4054-9ae7-94670f515bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:32 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (997b8408-d01f-40eb-aab9-861f28419cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:32 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-9aae3f3d-7eb9-47c7-a559-447e22e55fee tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created volume successfully.
Apr 13 20:36:33 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed" returned: 0 in 0.483s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:33 devstack sudo[90857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed
Apr 13 20:36:33 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:33 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b 1073741824" returned: 0 in 0.490s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:33 devstack sudo[90859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b
Apr 13 20:36:33 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:33 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f7867863-226d-43f8-8c6f-a6b21eddd7ed" returned: 0 in 0.444s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-quobyte-f7867863-226d-43f8-8c6f-a6b21eddd7ed" released by "delete_volume" :: held 0.956s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Created reservations ['5752b73e-46cd-40cb-8d95-b0c142850dd2', '548d91a0-b2a3-4111-8766-d57845d10ace', 'efb07886-9234-4901-99b3-3188ed723c7f', '0f93d8f2-a0a0-4f4f-926a-10ceeab38dd4'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:33 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b" returned: 0 in 0.442s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.327s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-quobyte-350236f4-1f14-4ec6-83e4-b8468d6a4aee-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" by "_create_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87ca55a-aa3c-4cae-a2bc-f8bbfc2f5674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779b0ef0-6332-4b99-9f89-7bef8345653b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9595b6ab-37fa-46c7-83bd-80974d9d73c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:33 devstack sudo[90863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:33 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-350236f4-1f14-4ec6-83e4-b8468d6a4aee-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Creating volume b4aa16e5-0e13-455e-b0e7-1d53752f7ee8 from snapshot 350236f4-1f14-4ec6-83e4-b8468d6a4aee {{(pid=82824) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-quobyte-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "cinder-8c2edfbe-bb5c-4c03-8127-91254be1b71c-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] snapshot: 350236f4-1f14-4ec6-83e4-b8468d6a4aee, volume: b4aa16e5-0e13-455e-b0e7-1d53752f7ee8,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-8c2edfbe-bb5c-4c03-8127-91254be1b71c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:33 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Volume volume-779b0ef0-6332-4b99-9f89-7bef8345653b (779b0ef0-6332-4b99-9f89-7bef8345653b): created successfully
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9595b6ab-37fa-46c7-83bd-80974d9d73c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Flow 'volume_create_manager' (46b64bd6-90b6-4807-9a3d-14d26a7e4691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8bd129-d179-48c6-97b6-80051bb32c92]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:33 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:34 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-750bff84-4f04-48ad-9d3e-2970227fe9a7 tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created volume successfully.
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "cinder-quobyte-8c2edfbe-bb5c-4c03-8127-91254be1b71c" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-quobyte-8c2edfbe-bb5c-4c03-8127-91254be1b71c" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c284db-e1b6-4f18-ade3-585bf9562e14]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:34 devstack sudo[90865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee
Apr 13 20:36:34 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:34 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c
Apr 13 20:36:34 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:34 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.452s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:34 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Deleted volume successfully.
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e1ec8b45-dab3-467e-9742-b7ece20cd3df tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-f7867863-226d-43f8-8c6f-a6b21eddd7ed-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:34 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee" returned: 0 in 0.499s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-948af6bf-64b5-4f03-b28a-8c76558aea08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ab271e-5eea-42fe-ba4c-2a1c7016b87e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:34 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c" returned: 0 in 0.498s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:34 devstack sudo[90877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c
Apr 13 20:36:34 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:34 devstack sudo[90876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08
Apr 13 20:36:34 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-779b0ef0-6332-4b99-9f89-7bef8345653b-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-779b0ef0-6332-4b99-9f89-7bef8345653b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-quobyte-779b0ef0-6332-4b99-9f89-7bef8345653b" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-779b0ef0-6332-4b99-9f89-7bef8345653b" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:34 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-8c2edfbe-bb5c-4c03-8127-91254be1b71c" returned: 0 in 0.449s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc0941b-119c-476d-bc8f-61501ccd5b9a]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:34 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-quobyte-8c2edfbe-bb5c-4c03-8127-91254be1b71c" released by "delete_volume" :: held 0.977s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:35 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08" returned: 0 in 0.528s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8 not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:35 devstack sudo[90885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8
Apr 13 20:36:35 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Created reservations ['7cfa9aee-154f-4d3d-8fb7-3b3e793f969b', '22ab841a-43d4-469a-a08d-2748f681de0f', '9de09e5b-48d2-4681-a374-f5e71f765b6a', '0d3f47bc-1b2a-4c9a-81c3-6c9f0730c17f'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:35 devstack sudo[90884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b
Apr 13 20:36:35 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:35 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:35 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:35 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.610s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:35 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Deleted volume successfully.
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-499d20c3-f209-4ab0-8617-e40c76ff0af2 tempest-CreateVolumesFromImageTest-825669753 None] Lock "cinder-8c2edfbe-bb5c-4c03-8127-91254be1b71c-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:35 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b" returned: 0 in 0.785s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:35 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:35 devstack sudo[90905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b
Apr 13 20:36:35 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:37 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-779b0ef0-6332-4b99-9f89-7bef8345653b" returned: 0 in 1.331s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-779b0ef0-6332-4b99-9f89-7bef8345653b" released by "delete_volume" :: held 2.154s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created reservations ['a6c10970-9f41-448e-9e38-8c73f33c4d63', 'ff283fd5-c9bc-4378-9351-48b9bbba3b87', 'eb5d0ee1-496d-4435-96b1-a8ba5e6350d6', '80547203-23bf-45fd-b20b-62cce4d5a766'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:37 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" returned: 0 in 2.157s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6329311-7a17-43c9-8652-678ebdd19b07]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:37 devstack sudo[90909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:37 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:37 devstack sudo[90908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08
Apr 13 20:36:37 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:37 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.453s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:37 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Deleted volume successfully.
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8a2fbc88-8cc1-432a-be8c-58a76ee38a8f tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-779b0ef0-6332-4b99-9f89-7bef8345653b-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:37 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08" returned: 0 in 0.719s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8 {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:36:37 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Converted 1024.00 MB image at 474.21 MB/s
Apr 13 20:36:37 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8 is being set with open permissions: ugo+rw
Apr 13 20:36:37 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:37 devstack sudo[90916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8
Apr 13 20:36:37 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-quobyte-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[4734bba8-50c6-439f-8ee8-eb2347970a23]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:38 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" returned: 0 in 0.474s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" released by "_copy_volume_from_snapshot" :: held 4.469s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-350236f4-1f14-4ec6-83e4-b8468d6a4aee-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" released by "_create_volume_from_snapshot" :: held 4.499s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.547s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.975s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1998150172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f75ff4-6372-4867-880b-7283eb6eca15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60729cc23a34e919cae2c6143dee2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:31Z,use_quota=True,user_id='9cfcacf444f24a4ea04b0950d6b7fddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Creating volume 61f75ff4-6372-4867-880b-7283eb6eca15 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:38 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:38 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1
Apr 13 20:36:38 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:38 devstack sudo[90920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 1073741824
Apr 13 20:36:38 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ac989b-b345-4a7e-a538-2522802c7f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8', 'volume_size': 1, 'snapshot_id': '350236f4-1f14-4ec6-83e4-b8468d6a4aee'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40585147-8eba-452a-8657-2fc2292eddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:38 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Volume volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8 (b4aa16e5-0e13-455e-b0e7-1d53752f7ee8): created successfully
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40585147-8eba-452a-8657-2fc2292eddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Flow 'volume_create_manager' (9c21d784-750e-4c08-8e52-fa281eb7abc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:38 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-890c0c8d-2e4b-40ec-8133-e617e3477f25 tempest-VolumeDependencyTests-541334121 None] Created volume successfully.
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (1c50363c-1f78-4b9d-bab8-5582fe8fa610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8984d156-b40e-486b-a29b-491cab5dc6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8984d156-b40e-486b-a29b-491cab5dc6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1943716743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461541fd-e73a-465a-8d50-d138cf732e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:38Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59406e69-1a3d-438d-967f-6e1298d46cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59406e69-1a3d-438d-967f-6e1298d46cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c833cff4-f8f1-4a31-b784-7106a91aa191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c833cff4-f8f1-4a31-b784-7106a91aa191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '461541fd-e73a-465a-8d50-d138cf732e33', 'volume_name': 'volume-461541fd-e73a-465a-8d50-d138cf732e33', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e417c3-0353-46c5-a5e3-37bd0ebebb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e417c3-0353-46c5-a5e3-37bd0ebebb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2280377-c73e-471e-99c2-526497a33208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:38 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume 461541fd-e73a-465a-8d50-d138cf732e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-461541fd-e73a-465a-8d50-d138cf732e33', 'volume_size': 1}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:38 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1" returned: 0 in 0.537s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:38 devstack sudo[90929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1
Apr 13 20:36:38 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:38 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 1073741824" returned: 0 in 0.517s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:38 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:39 devstack sudo[90931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15
Apr 13 20:36:39 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-350236f4-1f14-4ec6-83e4-b8468d6a4aee-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Lock "cinder-350236f4-1f14-4ec6-83e4-b8468d6a4aee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-quobyte-948af6bf-64b5-4f03-b28a-8c76558aea08" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-948af6bf-64b5-4f03-b28a-8c76558aea08" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-quobyte-350236f4-1f14-4ec6-83e4-b8468d6a4aee" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-350236f4-1f14-4ec6-83e4-b8468d6a4aee" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Deleting offline snapshot 350236f4-1f14-4ec6-83e4-b8468d6a4aee of volume 948af6bf-64b5-4f03-b28a-8c76558aea08 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] snapshot_file for this snap is: volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a68924-3872-4de1-806f-05675b8f720b]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:39 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee
Apr 13 20:36:39 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:39 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1" returned: 0 in 0.445s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1" released by "delete_volume" :: held 1.006s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created reservations ['6f1bda27-a052-4d45-a9a0-ecc742d6c74c', '42418153-c31f-4c42-963d-c972646d4c6e', '5856bef3-e5f3-4ddb-973a-f997dd228cfc', '0794820b-0aaa-4102-a2d5-4036a29e31aa'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:39 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15" returned: 0 in 0.444s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1943716743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461541fd-e73a-465a-8d50-d138cf732e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:38Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Creating volume 461541fd-e73a-465a-8d50-d138cf732e33 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:39 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:39 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:39 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165e6a43-5486-4eed-b1b9-cc853adc7b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f75ff4-6372-4867-880b-7283eb6eca15', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20ad7b9-bff3-4d90-8599-7daee347da05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:39 devstack sudo[90940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33 1073741824
Apr 13 20:36:39 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:39 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Volume volume-61f75ff4-6372-4867-880b-7283eb6eca15 (61f75ff4-6372-4867-880b-7283eb6eca15): created successfully
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20ad7b9-bff3-4d90-8599-7daee347da05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Flow 'volume_create_manager' (7707d8a9-a555-46ba-8420-7a0094640f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:39 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-0f022418-4f3e-4171-9d65-3f158d735ea6 tempest-SnapshotDependencyTests-959216360 None] Created volume successfully.
Apr 13 20:36:39 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee" returned: 0 in 0.530s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-948af6bf-64b5-4f03-b28a-8c76558aea08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[4730ce0e-b3ea-4505-b491-a63b7979a4a9]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:39 devstack sudo[90945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08
Apr 13 20:36:39 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:39 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.411s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:39 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Deleted volume successfully.
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-8fcd161b-e3b9-4d6e-aa2f-a4f94d5c467a tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-1e8048ee-dd27-45d7-bef6-9e4c2d1da4d1-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:39 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33 1073741824" returned: 0 in 0.489s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:39 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:39 devstack sudo[90951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33
Apr 13 20:36:39 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:40 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08" returned: 0 in 0.518s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:40 devstack sudo[90956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee
Apr 13 20:36:40 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:40 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33" returned: 0 in 0.437s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.157s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2280377-c73e-471e-99c2-526497a33208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-461541fd-e73a-465a-8d50-d138cf732e33', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f6df6a-e93a-45be-a388-6570c0fd3e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:40 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume volume-461541fd-e73a-465a-8d50-d138cf732e33 (461541fd-e73a-465a-8d50-d138cf732e33): created successfully
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f6df6a-e93a-45be-a388-6570c0fd3e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (1c50363c-1f78-4b9d-bab8-5582fe8fa610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] Creating offline snapshot f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 of volume 61f75ff4-6372-4867-880b-7283eb6eca15 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-7a37ba0f-146a-4a84-8009-6016719dedd9-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c01216c-d491-42f6-b0ce-b5a1d8405b38]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:40 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5c4cc50a-9d08-4741-8e06-0f165f7c5b68 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created volume successfully.
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-7a37ba0f-146a-4a84-8009-6016719dedd9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:40 devstack sudo[90959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-quobyte-7a37ba0f-146a-4a84-8009-6016719dedd9" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:40 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-7a37ba0f-146a-4a84-8009-6016719dedd9" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[a227457f-c7c0-4ede-a6dc-1085ba33a334]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:40 devstack sudo[90964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9
Apr 13 20:36:40 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:40 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee" returned: 0 in 0.512s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:40 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee
Apr 13 20:36:40 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:40 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:41 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15" returned: 0 in 0.552s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:41 devstack sudo[90975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 1G
Apr 13 20:36:41 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:41 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9" returned: 0 in 0.504s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:41 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:41 devstack sudo[90977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9
Apr 13 20:36:41 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08.350236f4-1f14-4ec6-83e4-b8468d6a4aee" returned: 0 in 0.414s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-350236f4-1f14-4ec6-83e4-b8468d6a4aee" released by "_delete_snapshot" :: held 2.038s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-948af6bf-64b5-4f03-b28a-8c76558aea08" released by "delete_snapshot" :: held 2.049s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Created reservations ['3a3bbc5a-8d5b-414b-9f6d-5e9f9a0ac436', '184afdea-5d32-4bea-a6d5-e2683804f624', '6b1af97a-16c1-4bf5-8ea6-f9c0372df29e', 'f4653bba-c953-47f4-8e0d-463724654b93'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Delete snapshot completed successfully.
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f881767b-254d-4a0b-899e-1deedd57d02f tempest-VolumeDependencyTests-541334121 None] Lock "cinder-350236f4-1f14-4ec6-83e4-b8468d6a4aee-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:41 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-7a37ba0f-146a-4a84-8009-6016719dedd9" returned: 0 in 0.418s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-7a37ba0f-146a-4a84-8009-6016719dedd9" released by "delete_volume" :: held 0.943s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:41 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 1G" returned: 0 in 0.486s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f75ff4-6372-4867-880b-7283eb6eca15 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:41 devstack sudo[90983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f75ff4-6372-4867-880b-7283eb6eca15 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2
Apr 13 20:36:41 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created reservations ['c2a02101-d077-45cd-bd28-2e5f4b652789', 'eee8e6a0-4762-41cf-b134-ad921f929c34', '8c493f5d-8763-48e5-9f8b-507a09d0c476', 'ebd97d1e-9666-46ea-a2e2-06330fe8e4c4'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:41 devstack sudo[90985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:41 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:41 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f75ff4-6372-4867-880b-7283eb6eca15 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2" returned: 0 in 0.417s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:41 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 is being set with open permissions: ugo+rw
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:41 devstack sudo[90991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2
Apr 13 20:36:41 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:41 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.411s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:41 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:41 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Deleted volume successfully.
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-33885799-1fd6-4ec8-803d-d1fb7c2113be tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-7a37ba0f-146a-4a84-8009-6016719dedd9-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-948af6bf-64b5-4f03-b28a-8c76558aea08-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Lock "cinder-948af6bf-64b5-4f03-b28a-8c76558aea08-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-quobyte-948af6bf-64b5-4f03-b28a-8c76558aea08" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-948af6bf-64b5-4f03-b28a-8c76558aea08" acquired by "delete_volume" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa667c2-56c8-401d-9042-bb0c0f87d1a4]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:42 devstack sudo[90993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08
Apr 13 20:36:42 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:42 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2" returned: 0 in 0.410s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:42 devstack sudo[90996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.info
Apr 13 20:36:42 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-acdc7b5b-fc32-4b48-907d-03d0ccc16281-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-acdc7b5b-fc32-4b48-907d-03d0ccc16281-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-quobyte-acdc7b5b-fc32-4b48-907d-03d0ccc16281" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-acdc7b5b-fc32-4b48-907d-03d0ccc16281" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:42 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08" returned: 0 in 0.494s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[188b00e4-7d53-47fb-a4b7-2dc58094bafd]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:42 devstack sudo[91002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08
Apr 13 20:36:42 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:42 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.info" returned: 0 in 0.464s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:42 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.info is being set with open permissions: ugo+rw
Apr 13 20:36:42 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:42 devstack sudo[91003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281
Apr 13 20:36:42 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:42 devstack sudo[91006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.info
Apr 13 20:36:42 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:43 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-948af6bf-64b5-4f03-b28a-8c76558aea08" returned: 0 in 0.434s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-948af6bf-64b5-4f03-b28a-8c76558aea08" released by "delete_volume" :: held 0.966s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Created reservations ['2e57ac2a-d0cd-4670-905b-5e9953224b9e', '4e700493-ef83-4bc4-be87-0e0bf4500657', '9df65d20-c487-40b6-8aff-e6c922bad0fd', 'f6210438-8319-4348-9061-72b6b6a09114'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:43 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.info" returned: 0 in 0.405s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.822s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.425s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:43 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281" returned: 0 in 0.502s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Creating offline snapshot dcc89454-957f-4971-a613-0d1301b14011 of volume 461541fd-e73a-465a-8d50-d138cf732e33 {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[724d08fe-413c-47f0-8d8b-e8d0fe1e75db]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:43 devstack sudo[91015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:43 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:43 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-8ed07546-9f68-4c7b-86d2-9e82f7d7615a tempest-SnapshotDependencyTests-959216360 None] Create snapshot completed successfully
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:43 devstack sudo[91018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:43 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:43 devstack sudo[91017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33
Apr 13 20:36:43 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Flow 'volume_create_manager' (13627a22-1f85-401d-8320-e3e2d48d1142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6a73ab-08be-4a9a-b91d-f9346a9c7665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6a73ab-08be-4a9a-b91d-f9346a9c7665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-530071239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8861db-4d0f-4598-9110-04da326773dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af411be7bb0548b68ebcaa18753cfe21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:44Z,use_quota=True,user_id='b015c857a47b49079b21780803d81890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6362905c-62a3-4586-8391-17db8798741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6362905c-62a3-4586-8391-17db8798741f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297f23a6-6bb2-4dfb-895c-9a407de7adf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297f23a6-6bb2-4dfb-895c-9a407de7adf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8861db-4d0f-4598-9110-04da326773dc', 'volume_name': 'volume-3d8861db-4d0f-4598-9110-04da326773dc', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a66193-6f61-4b41-9a37-cd2225c06123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a66193-6f61-4b41-9a37-cd2225c06123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67b26e8-88d7-4e44-ab61-d0d49de09eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:43 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Volume 3d8861db-4d0f-4598-9110-04da326773dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8861db-4d0f-4598-9110-04da326773dc', 'volume_size': 1}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:43 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-acdc7b5b-fc32-4b48-907d-03d0ccc16281" returned: 0 in 0.602s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-acdc7b5b-fc32-4b48-907d-03d0ccc16281" released by "delete_volume" :: held 1.136s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Flow 'volume_create_manager' (89037f00-3119-47ad-a940-a172b40dc4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a034a875-a02b-44c5-86c8-6106395489ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:43 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a034a875-a02b-44c5-86c8-6106395489ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2cca116-b488-43e6-bc7b-9a78bab85fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60729cc23a34e919cae2c6143dee2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5c1b3f1-3d9f-4aed-812a-edba352a5fd2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:44Z,use_quota=True,user_id='9cfcacf444f24a4ea04b0950d6b7fddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9e6208-16bf-43a5-aa3a-c1e6fd276cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9e6208-16bf-43a5-aa3a-c1e6fd276cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b236a067-c022-4064-bd0a-6ee644f24aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b236a067-c022-4064-bd0a-6ee644f24aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2cca116-b488-43e6-bc7b-9a78bab85fac', 'volume_name': 'volume-b2cca116-b488-43e6-bc7b-9a78bab85fac', 'volume_size': 1, 'snapshot_id': 'f5c1b3f1-3d9f-4aed-812a-edba352a5fd2'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555875ab-3e75-4987-a369-b98c41f38e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555875ab-3e75-4987-a369-b98c41f38e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278a78c1-e0d4-4716-a7b0-af8f91f6775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:43 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Volume b2cca116-b488-43e6-bc7b-9a78bab85fac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2cca116-b488-43e6-bc7b-9a78bab85fac', 'volume_size': 1, 'snapshot_id': 'f5c1b3f1-3d9f-4aed-812a-edba352a5fd2'}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.597s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:43 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Deleted volume successfully.
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-3110ac6c-2389-4f76-b8b9-39f6f61c75bf tempest-VolumeDependencyTests-541334121 None] Lock "cinder-948af6bf-64b5-4f03-b28a-8c76558aea08-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created reservations ['4ea3d262-3aa6-46d3-a603-3373a6ec1fe5', '94666779-a91a-4040-85d3-8270db31fd39', 'cca817e0-b331-4a67-a8d8-145237424af3', '8e781e88-2d1f-4813-b49b-a7a048747433'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:43 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:44 devstack sudo[91026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:44 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:44 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33" returned: 0 in 0.752s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:44 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011 1G
Apr 13 20:36:44 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:44 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.419s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:44 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Deleted volume successfully.
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-b32a3ea0-c793-427d-8fab-3116b48cce5c tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-acdc7b5b-fc32-4b48-907d-03d0ccc16281-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:44 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011 1G" returned: 0 in 0.471s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-461541fd-e73a-465a-8d50-d138cf732e33 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:44 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-461541fd-e73a-465a-8d50-d138cf732e33 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011
Apr 13 20:36:44 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-quobyte-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5" acquired by "delete_volume" :: waited 0.025s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[146cc198-b512-4f1d-abea-dc633515addf]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:44 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-461541fd-e73a-465a-8d50-d138cf732e33 -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011" returned: 0 in 0.454s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:44 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011 is being set with open permissions: ugo+rw
Apr 13 20:36:44 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:44 devstack sudo[91040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011
Apr 13 20:36:44 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:44 devstack sudo[91039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5
Apr 13 20:36:44 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:45 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5" returned: 0 in 0.461s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:45 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011" returned: 0 in 0.426s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:45 devstack sudo[91047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5
Apr 13 20:36:45 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:45 devstack sudo[91049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.info
Apr 13 20:36:45 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:45 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5" returned: 0 in 0.404s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5" released by "delete_volume" :: held 0.885s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created reservations ['ba376dc6-4951-401f-a5d6-4627b02356a5', '38445880-73b3-4039-b9e1-d26d223b26cd', 'f72b01dd-2326-4742-8b2d-977df6876b1b', '673dfb08-6d17-480a-927f-c7d93b4ecb4b'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:45 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.info" returned: 0 in 0.447s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:45 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.info is being set with open permissions: ugo+rw
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:45 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.info
Apr 13 20:36:45 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:45 devstack sudo[91055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:45 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:45 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-193fcbd7-3074-446b-aceb-c07023fbe117-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-193fcbd7-3074-446b-aceb-c07023fbe117-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "cinder-quobyte-193fcbd7-3074-446b-aceb-c07023fbe117" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-193fcbd7-3074-446b-aceb-c07023fbe117" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b9485b-2e5e-48c7-89f9-d2c42427d3d1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:46 devstack sudo[91057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117
Apr 13 20:36:46 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:46 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.info" returned: 0 in 0.430s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.065s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.662s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-530071239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8861db-4d0f-4598-9110-04da326773dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af411be7bb0548b68ebcaa18753cfe21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:44Z,use_quota=True,user_id='b015c857a47b49079b21780803d81890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Creating volume 3d8861db-4d0f-4598-9110-04da326773dc {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:46 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:46 devstack sudo[91061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc 1073741824
Apr 13 20:36:46 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:46 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1beaf474-bc22-47fd-bf6a-47c2d2d501b1 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Create snapshot completed successfully
Apr 13 20:36:46 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.460s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:46 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Deleted volume successfully.
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-093a7674-0c17-4133-a1a9-c30ed3fb6cbf tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-4210f88c-e42b-48b3-a9c1-5a2eb5eed5a5-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:46 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117" returned: 0 in 0.472s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:46 devstack sudo[91066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117
Apr 13 20:36:46 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:46 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc 1073741824" returned: 0 in 0.500s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:46 devstack sudo[91071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc
Apr 13 20:36:46 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:46 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-193fcbd7-3074-446b-aceb-c07023fbe117" returned: 0 in 0.455s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:46 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-quobyte-193fcbd7-3074-446b-aceb-c07023fbe117" released by "delete_volume" :: held 0.948s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Created reservations ['cedd1b9a-b115-4b16-a85c-7b4393681a61', '7cb57960-59ba-4377-b5e6-d23134e2cabf', '4488c8e1-398a-4ed8-8c96-21d21b0022cb', '9bcc90e8-dd59-405b-b0ee-ee494eae0629'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:47 devstack sudo[91074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:47 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (d0ba9d37-b41c-4b96-ad1c-1d0f0d3abebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28bda58-1d1a-4f1a-8f2b-641c35350472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28bda58-1d1a-4f1a-8f2b-641c35350472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1069340299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:47Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c19951-3807-417c-821f-9a6e91509862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c19951-3807-417c-821f-9a6e91509862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943abe4e-8a43-443d-a3f5-d97d0fded4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943abe4e-8a43-443d-a3f5-d97d0fded4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02', 'volume_name': 'volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0943d0-79ab-480b-b582-6440494c2755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0943d0-79ab-480b-b582-6440494c2755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e28e41-c542-4373-b2b9-e6e845f2ab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume 4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02', 'volume_size': 1}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:47 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc" returned: 0 in 0.482s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.385s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "cinder-quobyte-f5c1b3f1-3d9f-4aed-812a-edba352a5fd2-b2cca116-b488-43e6-bc7b-9a78bab85fac" by "_create_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67b26e8-88d7-4e44-ab61-d0d49de09eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8861db-4d0f-4598-9110-04da326773dc', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3d851e-7170-499f-988c-b15c817ab3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Volume volume-3d8861db-4d0f-4598-9110-04da326773dc (3d8861db-4d0f-4598-9110-04da326773dc): created successfully
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3d851e-7170-499f-988c-b15c817ab3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Flow 'volume_create_manager' (13627a22-1f85-401d-8320-e3e2d48d1142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-f5c1b3f1-3d9f-4aed-812a-edba352a5fd2-b2cca116-b488-43e6-bc7b-9a78bab85fac" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Creating volume b2cca116-b488-43e6-bc7b-9a78bab85fac from snapshot f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 {{(pid=82824) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "cinder-quobyte-b2cca116-b488-43e6-bc7b-9a78bab85fac" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-b2cca116-b488-43e6-bc7b-9a78bab85fac" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] snapshot: f5c1b3f1-3d9f-4aed-812a-edba352a5fd2, volume: b2cca116-b488-43e6-bc7b-9a78bab85fac,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:47 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-32a9c2ac-931d-40a2-9a22-71614f63984d tempest-VolumeDependencyTests-541334121 None] Created volume successfully.
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c3c5f4-65bc-4c42-9c03-43bb4f7d6fa7]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:47 devstack sudo[91077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2
Apr 13 20:36:47 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (1865d520-fa4c-48a5-b43b-7ab98a68836c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762317d2-9c31-4d78-b1b8-1b6cb09a1f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762317d2-9c31-4d78-b1b8-1b6cb09a1f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-268849388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca7b418-73e9-4c2c-a5bf-d15ac86727fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:47Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5496794a-8696-4099-9d30-1746f843e44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5496794a-8696-4099-9d30-1746f843e44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d947e4-0517-4e79-8ca5-bd805693b7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d947e4-0517-4e79-8ca5-bd805693b7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ca7b418-73e9-4c2c-a5bf-d15ac86727fa', 'volume_name': 'volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4d5c2d-0362-4fab-b063-21835986c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4d5c2d-0362-4fab-b063-21835986c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55610895-6513-44f3-b069-a8e1aec79955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume 9ca7b418-73e9-4c2c-a5bf-d15ac86727fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa', 'volume_size': 1}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (c3b66023-cb27-4f61-a91b-82282d024765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6e94d9-c05c-480f-9535-5ae78abfa4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6e94d9-c05c-480f-9535-5ae78abfa4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975750772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277d6762-1aee-4f6d-80ff-7b8a4eab58b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:48Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c08e31-4fd8-4582-bfdd-5e8da214db4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c08e31-4fd8-4582-bfdd-5e8da214db4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d393fae-ce5a-4656-b961-60ca0affdecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d393fae-ce5a-4656-b961-60ca0affdecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '277d6762-1aee-4f6d-80ff-7b8a4eab58b1', 'volume_name': 'volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73c3877-14b2-4b68-91f7-15cf82b5a8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73c3877-14b2-4b68-91f7-15cf82b5a8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07fc0cd1-07fc-4385-95c5-da1aeddf523a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:47 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume 277d6762-1aee-4f6d-80ff-7b8a4eab58b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1', 'volume_size': 1}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.720s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:47 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Deleted volume successfully.
Apr 13 20:36:47 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-fb4adaa9-ebfc-408b-b5c3-575beda7ca5e tempest-CreateVolumesFromSourceVolumeTest-229354204 None] Lock "cinder-193fcbd7-3074-446b-aceb-c07023fbe117-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (67f641a6-4149-4395-a859-1b14c3631f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:48 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03047ef-4ab9-4477-8313-83b62e0c9fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2" returned: 0 in 0.711s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f75ff4-6372-4867-880b-7283eb6eca15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03047ef-4ab9-4477-8313-83b62e0c9fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964657300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3eac1f-6741-4403-bbe0-3727dd295fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:48Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f9840c-1929-462f-97d8-228bb46cc7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f9840c-1929-462f-97d8-228bb46cc7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597e53f-ddc2-42c0-ae61-7b77307cc6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597e53f-ddc2-42c0-ae61-7b77307cc6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac3eac1f-6741-4403-bbe0-3727dd295fac', 'volume_name': 'volume-ac3eac1f-6741-4403-bbe0-3727dd295fac', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c22d41-20e8-4052-9424-557c5324e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c22d41-20e8-4052-9424-557c5324e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e3397e-f322-4d80-b566-220110028e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume ac3eac1f-6741-4403-bbe0-3727dd295fac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac3eac1f-6741-4403-bbe0-3727dd295fac', 'volume_size': 1}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bf337c-195b-417c-83f4-fdd20a170435]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:48 devstack sudo[91084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15
Apr 13 20:36:48 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (a572d4de-5b45-4d24-a162-15bad486bc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6034a97f-abcc-4ec6-8117-98b16b9e1156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6034a97f-abcc-4ec6-8117-98b16b9e1156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-99157128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cbecdb-9653-47ee-aa8e-eff836b61722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:48Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2173baf0-31ab-4369-8b79-be24815e9fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2173baf0-31ab-4369-8b79-be24815e9fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80de5e92-e1e7-4bf1-9749-7a8d0d9ed582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80de5e92-e1e7-4bf1-9749-7a8d0d9ed582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97cbecdb-9653-47ee-aa8e-eff836b61722', 'volume_name': 'volume-97cbecdb-9653-47ee-aa8e-eff836b61722', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f5bc6a-59e6-4469-aa3a-9dcf83833b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f5bc6a-59e6-4469-aa3a-9dcf83833b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60001b6-5d10-433a-97aa-47a071f60aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume 97cbecdb-9653-47ee-aa8e-eff836b61722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97cbecdb-9653-47ee-aa8e-eff836b61722', 'volume_size': 1}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Flow 'volume_create_manager' (89ccb76b-3866-4765-97ac-a52cde8f2068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cd9d85-9394-4d0f-886b-32148d2ca0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cd9d85-9394-4d0f-886b-32148d2ca0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1699075765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7ba6bd-d18a-47a8-b38c-406839c6575c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af411be7bb0548b68ebcaa18753cfe21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=3d8861db-4d0f-4598-9110-04da326773dc,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:48Z,use_quota=True,user_id='b015c857a47b49079b21780803d81890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba75cbc-59ce-47b8-bc81-1d0e74fa177d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba75cbc-59ce-47b8-bc81-1d0e74fa177d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3174d87b-4557-4ec0-8dd1-33d4e9209e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3174d87b-4557-4ec0-8dd1-33d4e9209e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3c7ba6bd-d18a-47a8-b38c-406839c6575c', 'volume_name': 'volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c', 'volume_size': 1, 'source_volid': '3d8861db-4d0f-4598-9110-04da326773dc', 'source_volstatus': 'available'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c15a3d0-c5bf-4734-a6d4-c89b7bdfa6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c15a3d0-c5bf-4734-a6d4-c89b7bdfa6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bde16fd-ef6d-481e-9cfe-47fbd74363f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:48 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Volume 3c7ba6bd-d18a-47a8-b38c-406839c6575c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c', 'volume_size': 1, 'source_volid': '3d8861db-4d0f-4598-9110-04da326773dc', 'source_volstatus': 'available'}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:48 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15" returned: 0 in 0.571s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:36:48 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:48 devstack sudo[91091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac
Apr 13 20:36:48 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Flow 'volume_create_manager' (ca20c671-c74a-447f-aa35-27d6bb049064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d407d54-215d-4cc7-b1d7-c6a84cb3be48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d407d54-215d-4cc7-b1d7-c6a84cb3be48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88f27ad-dc36-40dd-8418-43ed6b6c564b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871983d8ce714ee498958d04464a4f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:49Z,use_quota=True,user_id='89a230a084254468b35447430251ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bbe3e8-337c-4c29-8f1c-75bdbf59c144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bbe3e8-337c-4c29-8f1c-75bdbf59c144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e384b62-9066-404d-8280-cb41cf9380e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e384b62-9066-404d-8280-cb41cf9380e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f88f27ad-dc36-40dd-8418-43ed6b6c564b', 'volume_name': 'volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91de6d5d-8489-4a09-aaa1-9e038a69562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91de6d5d-8489-4a09-aaa1-9e038a69562d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f10dab-5345-4f3d-b6a4-5845b4b6ea76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:49 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Volume f88f27ad-dc36-40dd-8418-43ed6b6c564b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b', 'volume_size': 1}
Apr 13 20:36:49 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:50 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac" returned: 0 in 2.100s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:50 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c6596-9f3a-45df-8380-8b81cf7a3cf0]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:50 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:50 devstack sudo[91107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15
Apr 13 20:36:50 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:51 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15" returned: 0 in 0.577s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:36:51 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Converted 1024.00 MB image at 487.47 MB/s
Apr 13 20:36:51 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac is being set with open permissions: ugo+rw
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:51 devstack sudo[91112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac
Apr 13 20:36:51 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:51 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac" returned: 0 in 0.430s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-b2cca116-b488-43e6-bc7b-9a78bab85fac" released by "_copy_volume_from_snapshot" :: held 4.486s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-f5c1b3f1-3d9f-4aed-812a-edba352a5fd2-b2cca116-b488-43e6-bc7b-9a78bab85fac" released by "_create_volume_from_snapshot" :: held 4.520s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.555s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.574s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1069340299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:47Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Creating volume 4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:51 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:51 devstack sudo[91115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02 1073741824
Apr 13 20:36:51 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278a78c1-e0d4-4716-a7b0-af8f91f6775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2cca116-b488-43e6-bc7b-9a78bab85fac', 'volume_size': 1, 'snapshot_id': 'f5c1b3f1-3d9f-4aed-812a-edba352a5fd2'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279ccca5-350d-4e0f-8b0f-0b59927ba479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:51 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Volume volume-b2cca116-b488-43e6-bc7b-9a78bab85fac (b2cca116-b488-43e6-bc7b-9a78bab85fac): created successfully
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279ccca5-350d-4e0f-8b0f-0b59927ba479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:51 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Flow 'volume_create_manager' (89037f00-3119-47ad-a940-a172b40dc4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:51 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-e95dfa1b-62c5-4f5a-841e-3d3cd38383a6 tempest-SnapshotDependencyTests-959216360 None] Created volume successfully.
Apr 13 20:36:52 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02 1073741824" returned: 0 in 0.480s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:52 devstack sudo[91120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02
Apr 13 20:36:52 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "cinder-f5c1b3f1-3d9f-4aed-812a-edba352a5fd2-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-f5c1b3f1-3d9f-4aed-812a-edba352a5fd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "cinder-quobyte-61f75ff4-6372-4867-880b-7283eb6eca15" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-61f75ff4-6372-4867-880b-7283eb6eca15" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "cinder-quobyte-f5c1b3f1-3d9f-4aed-812a-edba352a5fd2" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-f5c1b3f1-3d9f-4aed-812a-edba352a5fd2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Deleting offline snapshot f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 of volume 61f75ff4-6372-4867-880b-7283eb6eca15 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] snapshot_file for this snap is: volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f376dd-4553-4709-8e27-10fa4791747e]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:52 devstack sudo[91122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2
Apr 13 20:36:52 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:52 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02" returned: 0 in 0.443s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.189s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-268849388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca7b418-73e9-4c2c-a5bf-d15ac86727fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:47Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Creating volume 9ca7b418-73e9-4c2c-a5bf-d15ac86727fa {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:52 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e28e41-c542-4373-b2b9-e6e845f2ab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:52 devstack sudo[91125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa 1073741824
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a47fd85-2296-4972-a3c1-4c6ea93ea912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:52 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:52 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02 (4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02): created successfully
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a47fd85-2296-4972-a3c1-4c6ea93ea912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:52 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (d0ba9d37-b41c-4b96-ad1c-1d0f0d3abebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:52 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-62e39a60-0b42-4f21-b290-b24a657c421e tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created volume successfully.
Apr 13 20:36:53 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2" returned: 0 in 0.481s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f75ff4-6372-4867-880b-7283eb6eca15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9e3745-3b1a-4216-9be6-cb821fbc52ce]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:53 devstack sudo[91130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15
Apr 13 20:36:53 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:53 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa 1073741824" returned: 0 in 0.508s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:53 devstack sudo[91135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa
Apr 13 20:36:53 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:53 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15" returned: 0 in 0.512s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:53 devstack sudo[91141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2
Apr 13 20:36:53 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:53 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa" returned: 0 in 0.433s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.994s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975750772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277d6762-1aee-4f6d-80ff-7b8a4eab58b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:48Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Creating volume 277d6762-1aee-4f6d-80ff-7b8a4eab58b1 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:53 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55610895-6513-44f3-b069-a8e1aec79955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:53 devstack sudo[91143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1 1073741824
Apr 13 20:36:53 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78166f8-298d-4948-b513-8190c0b7a0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:53 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa (9ca7b418-73e9-4c2c-a5bf-d15ac86727fa): created successfully
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78166f8-298d-4948-b513-8190c0b7a0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:53 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (1865d520-fa4c-48a5-b43b-7ab98a68836c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:53 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-7c2cedcc-c2be-4278-8ae7-70524ef4545b tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created volume successfully.
Apr 13 20:36:54 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2" returned: 0 in 0.461s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:54 devstack sudo[91151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2
Apr 13 20:36:54 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:54 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1 1073741824" returned: 0 in 0.478s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:54 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1
Apr 13 20:36:54 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:54 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15.f5c1b3f1-3d9f-4aed-812a-edba352a5fd2" returned: 0 in 0.425s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-f5c1b3f1-3d9f-4aed-812a-edba352a5fd2" released by "_delete_snapshot" :: held 1.944s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-61f75ff4-6372-4867-880b-7283eb6eca15" released by "delete_snapshot" :: held 1.955s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Created reservations ['19c9fd43-7bdf-40b5-bb68-6f66ab8e3802', '4a328b3a-4d10-4215-a1ab-81b305164d65', 'c20be00d-a9c6-4be0-95c9-005476fd7faa', '04eb23f7-26f2-4e34-93a3-a440bd47bf3f'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:54 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Delete snapshot completed successfully.
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a2961e07-ac20-4cac-8cea-c217327edc98 tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-f5c1b3f1-3d9f-4aed-812a-edba352a5fd2-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:54 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1" returned: 0 in 0.432s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.578s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964657300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3eac1f-6741-4403-bbe0-3727dd295fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:48Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Creating volume ac3eac1f-6741-4403-bbe0-3727dd295fac {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:54 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "cinder-61f75ff4-6372-4867-880b-7283eb6eca15-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:54 devstack sudo[91157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac 1073741824
Apr 13 20:36:54 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07fc0cd1-07fc-4385-95c5-da1aeddf523a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec36808-dcc2-4586-a187-8f036232712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-61f75ff4-6372-4867-880b-7283eb6eca15-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:54 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1 (277d6762-1aee-4f6d-80ff-7b8a4eab58b1): created successfully
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec36808-dcc2-4586-a187-8f036232712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (c3b66023-cb27-4f61-a91b-82282d024765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:54 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-3414ccd7-53f6-4529-a398-f1fdc4842dfd tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created volume successfully.
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "cinder-quobyte-61f75ff4-6372-4867-880b-7283eb6eca15" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-61f75ff4-6372-4867-880b-7283eb6eca15" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ed1363-f592-4032-80c3-74cebf6f0d69]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:54 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:54 devstack sudo[91159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15
Apr 13 20:36:54 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:55 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac 1073741824" returned: 0 in 0.511s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:55 devstack sudo[91165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac
Apr 13 20:36:55 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:55 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15" returned: 0 in 0.490s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:55 devstack sudo[91169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15
Apr 13 20:36:55 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:55 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac" returned: 0 in 0.406s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.227s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-99157128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cbecdb-9653-47ee-aa8e-eff836b61722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2207d5ab4b59424a9bab8b8be6ad8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:48Z,use_quota=True,user_id='6844a02890a5423e86930e607dea2dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Creating volume 97cbecdb-9653-47ee-aa8e-eff836b61722 {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:36:55 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e3397e-f322-4d80-b566-220110028e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3eac1f-6741-4403-bbe0-3727dd295fac', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:55 devstack sudo[91172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722 1073741824
Apr 13 20:36:55 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c70c31e-483b-402c-be04-ed28fbb652ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:55 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume volume-ac3eac1f-6741-4403-bbe0-3727dd295fac (ac3eac1f-6741-4403-bbe0-3727dd295fac): created successfully
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c70c31e-483b-402c-be04-ed28fbb652ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (67f641a6-4149-4395-a859-1b14c3631f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:55 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-1226d53d-9771-4214-8df5-2c1d5b0662bf tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created volume successfully.
Apr 13 20:36:55 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-61f75ff4-6372-4867-880b-7283eb6eca15" returned: 0 in 0.426s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-61f75ff4-6372-4867-880b-7283eb6eca15" released by "delete_volume" :: held 0.943s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Created reservations ['fddb6a49-8947-48a3-9a4e-2ade653a5114', '64df7174-ac84-4a00-8682-37ce5a5ed811', '562df384-94c7-435e-87e9-528d35c7f74b', 'c58f7cc7-0950-4dc9-9528-f1111a32a648'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:55 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:55 devstack sudo[91175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:55 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:56 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722 1073741824" returned: 0 in 0.519s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:56 devstack sudo[91181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722
Apr 13 20:36:56 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:56 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.435s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:56 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Deleted volume successfully.
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-2d058e84-be11-4605-b262-e7ebd39739fb tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-61f75ff4-6372-4867-880b-7283eb6eca15-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:56 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722" returned: 0 in 0.413s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.103s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:56 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Cloning volume 3d8861db-4d0f-4598-9110-04da326773dc to volume 3c7ba6bd-d18a-47a8-b38c-406839c6575c
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60001b6-5d10-433a-97aa-47a071f60aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97cbecdb-9653-47ee-aa8e-eff836b61722', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b4328c-12df-4287-96a2-b51573a892cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Creating offline snapshot 26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 of volume 3d8861db-4d0f-4598-9110-04da326773dc {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:36:56 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Volume volume-97cbecdb-9653-47ee-aa8e-eff836b61722 (97cbecdb-9653-47ee-aa8e-eff836b61722): created successfully
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b4328c-12df-4287-96a2-b51573a892cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Flow 'volume_create_manager' (a572d4de-5b45-4d24-a162-15bad486bc34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[30927598-465c-41f5-ad03-03af497467db]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:56 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-ce6f86a3-15bc-4dfe-bf57-6aa1c49c3300 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created volume successfully.
Apr 13 20:36:56 devstack sudo[91184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc
Apr 13 20:36:56 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "cinder-b2cca116-b488-43e6-bc7b-9a78bab85fac-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-b2cca116-b488-43e6-bc7b-9a78bab85fac-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:56 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "cinder-quobyte-b2cca116-b488-43e6-bc7b-9a78bab85fac" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-b2cca116-b488-43e6-bc7b-9a78bab85fac" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccae8633-9302-4d9e-a101-f74c54b74376]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:57 devstack sudo[91186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac
Apr 13 20:36:57 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-97cbecdb-9653-47ee-aa8e-eff836b61722-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-97cbecdb-9653-47ee-aa8e-eff836b61722-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-quobyte-97cbecdb-9653-47ee-aa8e-eff836b61722" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-97cbecdb-9653-47ee-aa8e-eff836b61722" acquired by "delete_volume" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca131c0-2cec-41b2-8b7e-2b7099671771]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:57 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc" returned: 0 in 0.520s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:57 devstack sudo[91191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722
Apr 13 20:36:57 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:57 devstack sudo[91192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 1G
Apr 13 20:36:57 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:57 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac" returned: 0 in 0.479s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:57 devstack sudo[91198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac
Apr 13 20:36:57 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_service.periodic_task [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82824) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:57 devstack sudo[91205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:57 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:57 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722" returned: 0 in 0.502s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:57 devstack sudo[91208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722
Apr 13 20:36:57 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:57 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 1G" returned: 0 in 0.515s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8861db-4d0f-4598-9110-04da326773dc -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:57 devstack sudo[91210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8861db-4d0f-4598-9110-04da326773dc -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94
Apr 13 20:36:57 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:57 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b2cca116-b488-43e6-bc7b-9a78bab85fac" returned: 0 in 0.440s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:57 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-quobyte-b2cca116-b488-43e6-bc7b-9a78bab85fac" released by "delete_volume" :: held 0.949s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Created reservations ['d27ba47e-3e84-43d9-b85e-e2b4778ea34f', '0caf142c-5a14-4111-9cc8-c2ea9c0298d0', '617fcf6a-3eae-4027-9cd5-ab2c176c6805', '31ce362e-cfe6-4a39-a944-88b64d34aaed'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:58 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.470s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e18a7501-e4f6-4162-bb73-2e016ca415d3 None None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:58 devstack sudo[91215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:58 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:58 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-97cbecdb-9653-47ee-aa8e-eff836b61722" returned: 0 in 0.507s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-97cbecdb-9653-47ee-aa8e-eff836b61722" released by "delete_volume" :: held 1.039s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:58 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created reservations ['0057d096-9c06-411d-83bb-97e5f514ef1e', 'e5210b05-c852-4fa8-9931-bab4e2c9376a', 'df490207-8b3c-498d-828b-4efaf6848d43', 'ea9a6b98-c4be-4c43-a4ad-53c7fdae02f8'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8861db-4d0f-4598-9110-04da326773dc -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94" returned: 0 in 0.521s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:58 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 is being set with open permissions: ugo+rw
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:58 devstack sudo[91220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94
Apr 13 20:36:58 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:58 devstack sudo[91222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:36:58 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:58 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.511s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:58 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Deleted volume successfully.
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a65f6e69-1982-4157-9938-604a33ecdf8b tempest-SnapshotDependencyTests-959216360 None] Lock "cinder-b2cca116-b488-43e6-bc7b-9a78bab85fac-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:58 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94" returned: 0 in 0.458s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:58 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.441s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:36:58 devstack sudo[91227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.info
Apr 13 20:36:58 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:58 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Deleted volume successfully.
Apr 13 20:36:58 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-884cdce0-9701-43f4-a035-9bbeadfb9c5d tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-97cbecdb-9653-47ee-aa8e-eff836b61722-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:36:59 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.info" returned: 0 in 0.433s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:59 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.info is being set with open permissions: ugo+rw
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:59 devstack sudo[91231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.info
Apr 13 20:36:59 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-ac3eac1f-6741-4403-bbe0-3727dd295fac-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-ac3eac1f-6741-4403-bbe0-3727dd295fac-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-quobyte-ac3eac1f-6741-4403-bbe0-3727dd295fac" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-ac3eac1f-6741-4403-bbe0-3727dd295fac" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aa0234-4da4-46a0-b27f-2267aa90d7da]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:59 devstack sudo[91234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac
Apr 13 20:36:59 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:59 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.info" returned: 0 in 0.418s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-quobyte-3c7ba6bd-d18a-47a8-b38c-406839c6575c" by "_copy_volume_from_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-3c7ba6bd-d18a-47a8-b38c-406839c6575c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] snapshot: 26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94, volume: 3c7ba6bd-d18a-47a8-b38c-406839c6575c,  {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a686ed0-40c9-4cec-b331-0c62ea9d3d69]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:59 devstack sudo[91237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94
Apr 13 20:36:59 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:36:59 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac" returned: 0 in 0.534s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:36:59 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:36:59 devstack sudo[91242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac
Apr 13 20:36:59 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:00 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94" returned: 0 in 0.556s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8861db-4d0f-4598-9110-04da326773dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Creating direct copy from snapshot {{(pid=82824) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[151f751a-f0db-44cd-8622-039f7f1bb792]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:00 devstack sudo[91247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc
Apr 13 20:37:00 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:00 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-ac3eac1f-6741-4403-bbe0-3727dd295fac" returned: 0 in 0.501s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-ac3eac1f-6741-4403-bbe0-3727dd295fac" released by "delete_volume" :: held 1.071s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created reservations ['e6634512-f17e-4643-8d0f-441cf1b2a3a6', 'f79961c0-9b75-41fa-9853-4a38218826a3', '10dbbba6-1098-4d16-b280-13d12a6cfc11', 'a67cb556-70cb-42ef-9deb-b9aab7cb37d8'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:00 devstack sudo[91250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:37:00 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:00 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc" returned: 0 in 0.532s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG cinder.utils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Path /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c not found in is_blk_device check {{(pid=82824) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:00 devstack sudo[91256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c
Apr 13 20:37:00 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:00 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.473s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:00 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:37:01 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Deleted volume successfully.
Apr 13 20:37:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-aa9048b6-1cf1-48b6-b0a8-e5ee28f8ae28 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-ac3eac1f-6741-4403-bbe0-3727dd295fac-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-277d6762-1aee-4f6d-80ff-7b8a4eab58b1-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-277d6762-1aee-4f6d-80ff-7b8a4eab58b1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-quobyte-277d6762-1aee-4f6d-80ff-7b8a4eab58b1" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:01 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-277d6762-1aee-4f6d-80ff-7b8a4eab58b1" acquired by "delete_volume" :: waited 0.058s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:01 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f533b7-6ea5-46a2-83f2-39ef5db065f6]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:01 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:02 devstack sudo[91269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1
Apr 13 20:37:02 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:02 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c" returned: 0 in 2.187s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:02 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be63e69-aa2c-4b8e-a5b6-b3174490e1e1]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:02 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:03 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1" returned: 0 in 1.084s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:03 devstack sudo[91275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc
Apr 13 20:37:03 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:03 devstack sudo[91276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1
Apr 13 20:37:03 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:03 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-277d6762-1aee-4f6d-80ff-7b8a4eab58b1" returned: 0 in 0.419s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-277d6762-1aee-4f6d-80ff-7b8a4eab58b1" released by "delete_volume" :: held 1.564s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created reservations ['22df9c36-d101-42f3-a08a-2f6772560165', '722efd16-54e8-4bc3-a729-a18506c873ef', '8be62a84-8890-4de6-9117-67a65cba23bf', '51b0d99a-a382-44ed-a3f0-509b0f985799'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:03 devstack sudo[91282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:37:03 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:03 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc" returned: 0 in 0.712s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG cinder.image.image_utils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c {{(pid=82824) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 20:37:03 devstack cinder-volume[82824]: INFO cinder.image.image_utils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Converted 1024.00 MB image at 467.92 MB/s
Apr 13 20:37:03 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c is being set with open permissions: ugo+rw
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:03 devstack sudo[91285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c
Apr 13 20:37:03 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:03 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:UPDATE=244,cinder:DELETE=27,cinder:SELECT=183,cinder:INSERT=61 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:37:04 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.518s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:37:04 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Deleted volume successfully.
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-quobyte-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa" acquired by "delete_volume" :: waited 0.023s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-4136d6f9-a869-4a33-94e8-8758acd536cb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-277d6762-1aee-4f6d-80ff-7b8a4eab58b1-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bf2593-4fa8-4f79-b901-a7f0effe1504]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:04 devstack sudo[91288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa
Apr 13 20:37:04 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:04 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c" returned: 0 in 0.558s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-3c7ba6bd-d18a-47a8-b38c-406839c6575c" released by "_copy_volume_from_snapshot" :: held 4.592s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-quobyte-26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Deleting offline snapshot 26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 of volume 3d8861db-4d0f-4598-9110-04da326773dc {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] snapshot_file for this snap is: volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e303a-c45b-4d49-9848-d9d6705f4173]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:04 devstack sudo[91292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94
Apr 13 20:37:04 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:04 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa" returned: 0 in 0.541s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:04 devstack sudo[91297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa
Apr 13 20:37:04 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:04 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94" returned: 0 in 0.559s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8861db-4d0f-4598-9110-04da326773dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c91d11-5ddf-4bd9-8a30-a303f02551af]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:04 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:04 devstack sudo[91302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc
Apr 13 20:37:04 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:05 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa" returned: 0 in 0.526s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa" released by "delete_volume" :: held 1.091s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created reservations ['2098a887-1831-4573-ad5c-1d2fb60051cf', '0f6c8443-6eca-45fc-bebb-0efcdb40e821', '1ad96616-7313-4b37-a492-d77668f79e33', '31003d6b-9f38-4919-92f2-61bb89491fc7'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:05 devstack sudo[91305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:37:05 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:05 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc" returned: 0 in 0.550s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:05 devstack sudo[91310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94
Apr 13 20:37:05 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:05 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.430s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:37:05 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Deleted volume successfully.
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e833b164-b8e7-4bc0-a5fa-fb44554366ff tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-9ca7b418-73e9-4c2c-a5bf-d15ac86727fa-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:05 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94" returned: 0 in 0.469s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:05 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:05 devstack sudo[91316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94
Apr 13 20:37:05 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-quobyte-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acb0d61-2807-4828-8e5f-c9e535662590]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:06 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc.26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94" returned: 0 in 0.456s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-26a6b3ea-ab5e-4a7a-9597-6e36fac8ad94" released by "_delete_snapshot" :: held 2.083s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:06 devstack sudo[91319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02
Apr 13 20:37:06 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.683s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.893s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88f27ad-dc36-40dd-8418-43ed6b6c564b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871983d8ce714ee498958d04464a4f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:36:49Z,use_quota=True,user_id='89a230a084254468b35447430251ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Creating volume f88f27ad-dc36-40dd-8418-43ed6b6c564b {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:37:06 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bde16fd-ef6d-481e-9cfe-47fbd74363f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c', 'volume_size': 1, 'source_volid': '3d8861db-4d0f-4598-9110-04da326773dc', 'source_volstatus': 'available'}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f9cee2-684a-46f2-8ad9-f6a633d26f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:37:06 devstack sudo[91321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b 1073741824
Apr 13 20:37:06 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Volume volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c (3c7ba6bd-d18a-47a8-b38c-406839c6575c): created successfully
Apr 13 20:37:06 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f9cee2-684a-46f2-8ad9-f6a633d26f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Flow 'volume_create_manager' (89ccb76b-3866-4765-97ac-a52cde8f2068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:37:06 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-56506b08-31f2-47d9-885b-79febc19dad6 tempest-VolumeDependencyTests-541334121 None] Created volume successfully.
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-3d8861db-4d0f-4598-9110-04da326773dc-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-3d8861db-4d0f-4598-9110-04da326773dc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-quobyte-3d8861db-4d0f-4598-9110-04da326773dc" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-3d8861db-4d0f-4598-9110-04da326773dc" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc33bc3f-39dd-40c9-95da-a1150e55b8ef]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:06 devstack sudo[91323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc
Apr 13 20:37:06 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:06 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02" returned: 0 in 0.491s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:06 devstack sudo[91331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02
Apr 13 20:37:06 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:06 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b 1073741824" returned: 0 in 0.548s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:06 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:06 devstack sudo[91333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b
Apr 13 20:37:06 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:07 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc" returned: 0 in 0.512s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:07 devstack sudo[91338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc
Apr 13 20:37:07 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:07 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02" returned: 0 in 0.494s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02" released by "delete_volume" :: held 1.007s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created reservations ['98b0eb83-af34-4cf6-ab21-e2653c707f9e', '8dda8333-6967-4512-a79a-0cd1a72624af', '6e27044e-2145-4a8f-acc1-e9f8a1936c5d', '80a01b72-cbf3-4dcd-93a1-e60499420f36'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:07 devstack sudo[91342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:37:07 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:07 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b" returned: 0 in 0.447s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-dcc89454-957f-4971-a613-0d1301b14011-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f10dab-5345-4f3d-b6a4-5845b4b6ea76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfd80ea-e4d8-44bd-aaf4-c1542f269d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:37:07 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Volume volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b (f88f27ad-dc36-40dd-8418-43ed6b6c564b): created successfully
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfd80ea-e4d8-44bd-aaf4-c1542f269d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Flow 'volume_create_manager' (ca20c671-c74a-447f-aa35-27d6bb049064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-dcc89454-957f-4971-a613-0d1301b14011-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-quobyte-461541fd-e73a-465a-8d50-d138cf732e33" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:07 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-47cef71d-609e-4f9d-842c-f18f13ca1937 tempest-CinderUnicodeTest-389852309 None] Created volume successfully.
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-461541fd-e73a-465a-8d50-d138cf732e33" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-quobyte-dcc89454-957f-4971-a613-0d1301b14011" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-dcc89454-957f-4971-a613-0d1301b14011" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Deleting offline snapshot dcc89454-957f-4971-a613-0d1301b14011 of volume 461541fd-e73a-465a-8d50-d138cf732e33 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] snapshot_file for this snap is: volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a653d6-65fc-4559-89a8-b31e4e4014ef]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:07 devstack sudo[91344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011
Apr 13 20:37:07 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:07 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3d8861db-4d0f-4598-9110-04da326773dc" returned: 0 in 0.481s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-3d8861db-4d0f-4598-9110-04da326773dc" released by "delete_volume" :: held 1.024s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Created reservations ['c38cb78b-fd82-4747-9275-a45016b309a5', '91e820da-7611-4048-b93f-e5f39edae36e', 'bb3fdabb-3da4-4fa6-92a3-b07b6fb53556', '33322c92-ca85-431a-85af-1b95d380daac'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:07 devstack sudo[91347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:37:07 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:07 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.439s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:37:07 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Deleted volume successfully.
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-a690b33f-1b95-4bd1-88cc-42fc7f6f4ad3 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-4c5efa5f-f7e2-44c5-a9a9-d759e76b8c02-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:07 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011" returned: 0 in 0.517s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-461541fd-e73a-465a-8d50-d138cf732e33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d245860-2791-4773-8acd-3d79c82d9eea]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:07 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:08 devstack sudo[91353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33
Apr 13 20:37:08 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:08 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.445s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:37:08 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Deleted volume successfully.
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-237de27b-1562-4c63-a5d6-fb54b501d6d3 tempest-VolumeDependencyTests-541334121 None] Lock "cinder-3d8861db-4d0f-4598-9110-04da326773dc-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:08 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33" returned: 0 in 0.506s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:08 devstack sudo[91359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011
Apr 13 20:37:08 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82824) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Flow 'volume_create_manager' (a534878a-64b9-4d8e-9e35-e9168046eede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0bb88d-f8bd-4718-935e-5bc65d21ec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0bb88d-f8bd-4718-935e-5bc65d21ec11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:37:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2104886844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f991e538-b5b0-49f1-b20e-7fc6f69e73df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871983d8ce714ee498958d04464a4f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:37:09Z,use_quota=True,user_id='89a230a084254468b35447430251ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c188a7af-1ee4-4ef2-b8b9-dd0cfe7d6dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c188a7af-1ee4-4ef2-b8b9-dd0cfe7d6dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f0ec95-b9c5-466f-a1a3-097d678ad9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f0ec95-b9c5-466f-a1a3-097d678ad9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f991e538-b5b0-49f1-b20e-7fc6f69e73df', 'volume_name': 'volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44b37df-ff55-4a58-84b3-34735b95fffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44b37df-ff55-4a58-84b3-34735b95fffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4591f8d9-976c-4eed-b1ff-f4cead498ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:37:08 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Volume f991e538-b5b0-49f1-b20e-7fc6f69e73df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df', 'volume_size': 1}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f37f1424430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T18:37:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2104886844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f991e538-b5b0-49f1-b20e-7fc6f69e73df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871983d8ce714ee498958d04464a4f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T18:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T18:37:09Z,use_quota=True,user_id='89a230a084254468b35447430251ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(951f17f9-55b6-4c10-bd97-57080eef235f),volume_type_id=951f17f9-55b6-4c10-bd97-57080eef235f)}" {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Creating volume f991e538-b5b0-49f1-b20e-7fc6f69e73df {{(pid=82824) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Selected osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b as target Quobyte volume. {{(pid=82824) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 20:37:08 devstack cinder-volume[82824]: INFO cinder.volume.drivers.remotefs [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] casted to osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df 1073741824 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:08 devstack sudo[91361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df 1073741824
Apr 13 20:37:08 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-3c7ba6bd-d18a-47a8-b38c-406839c6575c-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Lock "cinder-3c7ba6bd-d18a-47a8-b38c-406839c6575c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-quobyte-3c7ba6bd-d18a-47a8-b38c-406839c6575c" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-3c7ba6bd-d18a-47a8-b38c-406839c6575c" acquired by "delete_volume" :: waited 0.012s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0be585-da88-4b83-a25d-eb5bb923ac3a]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:08 devstack sudo[91363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c
Apr 13 20:37:08 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:08 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011" returned: 0 in 0.503s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:08 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:09 devstack sudo[91368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011
Apr 13 20:37:09 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:09 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df 1073741824" returned: 0 in 0.541s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:09 devstack sudo[91376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df
Apr 13 20:37:09 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:09 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c" returned: 0 in 0.513s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:09 devstack sudo[91378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c
Apr 13 20:37:09 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:09 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33.dcc89454-957f-4971-a613-0d1301b14011" returned: 0 in 0.450s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-dcc89454-957f-4971-a613-0d1301b14011" released by "_delete_snapshot" :: held 2.048s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-461541fd-e73a-465a-8d50-d138cf732e33" released by "delete_snapshot" :: held 2.062s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created reservations ['b1acefad-daaa-4d68-b785-33d48ab785b9', 'cefaa660-870a-4589-992a-0c579237171f', '9cc2b0b6-246c-49cd-b597-b54570f7100c', '54b3a72a-3393-43a1-810c-9d8acb6955cf'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:09 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Delete snapshot completed successfully.
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-e3ee14fc-a5d7-42e6-86b5-84f6d0f6ec17 tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-dcc89454-957f-4971-a613-0d1301b14011-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:09 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df" returned: 0 in 0.458s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'} {{(pid=82824) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4591f8d9-976c-4eed-b1ff-f4cead498ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df', 'volume_size': 1}' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1151ca-a5e2-46ea-982b-f96a2e469ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 20:37:09 devstack cinder-volume[82824]: INFO cinder.volume.flows.manager.create_volume [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Volume volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df (f991e538-b5b0-49f1-b20e-7fc6f69e73df): created successfully
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1151ca-a5e2-46ea-982b-f96a2e469ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82824) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Flow 'volume_create_manager' (a534878a-64b9-4d8e-9e35-e9168046eede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82824) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 20:37:09 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-6e3eca9c-17b7-462a-9835-26eeb1471be4 tempest-CinderUnicodeTest-389852309 None] Created volume successfully.
Apr 13 20:37:09 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-3c7ba6bd-d18a-47a8-b38c-406839c6575c" returned: 0 in 0.433s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-3c7ba6bd-d18a-47a8-b38c-406839c6575c" released by "delete_volume" :: held 0.967s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Created reservations ['44a55ad0-3abc-44a5-86e1-d299815fe6ab', '3491c437-7129-4eaa-8860-ab373a09367b', '90c06e84-3278-47dd-bd7e-82bc5953b310', 'b4dc7b60-b0c9-4828-a329-baafa33f2c39'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:09 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:09 devstack sudo[91384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:37:09 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:10 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.397s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:37:10 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Deleted volume successfully.
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-f93527cd-091c-4938-8ece-70f87b15781d tempest-VolumeDependencyTests-541334121 None] Lock "cinder-3c7ba6bd-d18a-47a8-b38c-406839c6575c-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-461541fd-e73a-465a-8d50-d138cf732e33-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-461541fd-e73a-465a-8d50-d138cf732e33-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "cinder-quobyte-461541fd-e73a-465a-8d50-d138cf732e33" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-461541fd-e73a-465a-8d50-d138cf732e33" acquired by "delete_volume" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[5453ab34-0be0-46b3-9558-73fc8abfa160]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:10 devstack sudo[91393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33
Apr 13 20:37:10 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] Creating offline snapshot 3d9df68d-ae7f-41e3-a892-f92cb6b81d80 of volume f991e538-b5b0-49f1-b20e-7fc6f69e73df {{(pid=82824) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[342786ca-78c2-4c9c-8a5d-367873628b37]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:10 devstack sudo[91395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df
Apr 13 20:37:10 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:10 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Lock "cinder-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Acquiring lock "cinder-quobyte-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" acquired by "delete_volume" :: waited 0.006s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[defd44e7-266e-4e5f-89f3-76594636a5c9]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:11 devstack sudo[91397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8
Apr 13 20:37:11 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:11 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33" returned: 0 in 0.572s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:11 devstack sudo[91402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33
Apr 13 20:37:11 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:11 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df" returned: 0 in 0.509s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80 1G {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:11 devstack sudo[91407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80 1G
Apr 13 20:37:11 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:11 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" returned: 0 in 0.499s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:11 devstack sudo[91413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8
Apr 13 20:37:11 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:11 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-461541fd-e73a-465a-8d50-d138cf732e33" returned: 0 in 0.431s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-quobyte-461541fd-e73a-465a-8d50-d138cf732e33" released by "delete_volume" :: held 1.040s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Created reservations ['307595f2-cd11-466b-9231-9fd0b479d50e', '19a348af-c3a3-4008-b667-c81487edb278', '19c8afc9-f226-48f4-a036-eaf5967068a0', '3bc74976-c906-45e6-ac21-940b46cdb9b2'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:11 devstack sudo[91415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:37:11 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:11 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80 1G" returned: 0 in 0.515s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:11 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:11 devstack sudo[91421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80
Apr 13 20:37:11 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:12 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" returned: 0 in 0.472s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Lock "cinder-quobyte-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8" released by "delete_volume" :: held 0.991s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Created reservations ['5dfdaade-3c0d-4e67-bee9-9a9f01db26a9', '25295c5e-acb3-4449-a848-74f8a1bbba01', 'f7df0951-1e70-46a4-8272-250ca4ab21d7', 'a0bdd4eb-3eb0-4ef4-9f83-7c99c427fb2f'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:12 devstack sudo[91424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:37:12 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:12 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.468s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:37:12 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Deleted volume successfully.
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-5120bf5e-c3b9-4ce3-90d0-10ab1706b3fb tempest-CreateVolumesFromSnapshotTest-1194069801 None] Lock "cinder-461541fd-e73a-465a-8d50-d138cf732e33-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:12 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df -F qcow2 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80" returned: 0 in 0.445s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:12 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80 is being set with open permissions: ugo+rw
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:12 devstack sudo[91429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80
Apr 13 20:37:12 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:12 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.444s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:37:12 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Deleted volume successfully.
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-c9fe5ee5-7214-407d-a71b-a91004d6c68f tempest-VolumeDependencyTests-541334121 None] Lock "cinder-b4aa16e5-0e13-455e-b0e7-1d53752f7ee8-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:12 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80" returned: 0 in 0.436s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:12 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:12 devstack sudo[91433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.info
Apr 13 20:37:12 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:13 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.info" returned: 0 in 0.512s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:13 devstack cinder-volume[82824]: WARNING cinder.volume.drivers.remotefs [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.info is being set with open permissions: ugo+rw
Apr 13 20:37:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.info {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:13 devstack sudo[91436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.info
Apr 13 20:37:13 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:13 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.info" returned: 0 in 0.528s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:13 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.006s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:13 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-7ddb7b03-bc41-4164-96dd-8a72043d3758 tempest-CinderUnicodeTest-389852309 None] Create snapshot completed successfully
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "cinder-3d9df68d-ae7f-41e3-a892-f92cb6b81d80-delete_snapshot" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-3d9df68d-ae7f-41e3-a892-f92cb6b81d80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "cinder-quobyte-f991e538-b5b0-49f1-b20e-7fc6f69e73df" by "delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-quobyte-f991e538-b5b0-49f1-b20e-7fc6f69e73df" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "cinder-quobyte-3d9df68d-ae7f-41e3-a892-f92cb6b81d80" by "_delete_snapshot" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-quobyte-3d9df68d-ae7f-41e3-a892-f92cb6b81d80" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Deleting offline snapshot 3d9df68d-ae7f-41e3-a892-f92cb6b81d80 of volume f991e538-b5b0-49f1-b20e-7fc6f69e73df {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] snapshot_file for this snap is: volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80 {{(pid=82824) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fff4e1-1466-4780-8699-a3c6d94cc8e3]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:14 devstack sudo[91439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80
Apr 13 20:37:14 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:14 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80" returned: 0 in 0.482s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.remotefs [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82824) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[af142d6e-25bb-4eea-bd68-91a593cdd734]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:14 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:14 devstack sudo[91444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df
Apr 13 20:37:14 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:15 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df" returned: 0 in 0.463s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:15 devstack sudo[91449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80
Apr 13 20:37:15 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:15 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80" returned: 0 in 0.449s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:15 devstack sudo[91454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80
Apr 13 20:37:15 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:15 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:15 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df.3d9df68d-ae7f-41e3-a892-f92cb6b81d80" returned: 0 in 0.418s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-quobyte-3d9df68d-ae7f-41e3-a892-f92cb6b81d80" released by "_delete_snapshot" :: held 1.873s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:15 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-quobyte-f991e538-b5b0-49f1-b20e-7fc6f69e73df" released by "delete_snapshot" :: held 1.887s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:16 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Created reservations ['cf0ee42c-bace-4650-92b2-3f8bdcebb030', '7578ccae-91c9-4dcb-a71a-42287a8a010c', 'a3aa40ba-6c9e-4902-84cc-746adf1508da', 'e4f51248-38c7-4283-8aed-fe915f95746a'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:16 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Delete snapshot completed successfully.
Apr 13 20:37:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-310164b1-7ca4-4ceb-a1ef-d69e6bd64025 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-3d9df68d-ae7f-41e3-a892-f92cb6b81d80-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "cinder-f991e538-b5b0-49f1-b20e-7fc6f69e73df-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-f991e538-b5b0-49f1-b20e-7fc6f69e73df-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "cinder-quobyte-f991e538-b5b0-49f1-b20e-7fc6f69e73df" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:16 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-quobyte-f991e538-b5b0-49f1-b20e-7fc6f69e73df" acquired by "delete_volume" :: waited 0.008s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:16 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0481aeb-0fe7-44df-8dab-e20f7e49451f]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:16 devstack sudo[91457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df
Apr 13 20:37:16 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:16 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df" returned: 0 in 0.473s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:16 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:16 devstack sudo[91462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df
Apr 13 20:37:16 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:17 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f991e538-b5b0-49f1-b20e-7fc6f69e73df" returned: 0 in 0.415s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-quobyte-f991e538-b5b0-49f1-b20e-7fc6f69e73df" released by "delete_volume" :: held 0.926s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Created reservations ['b31578aa-b748-42bb-b2d8-58a7c5c70fee', '95e3c894-7192-4360-ba30-41bef8d9cd59', 'c866cfb9-9988-4724-bf0f-406af88cbe2c', '1de07be4-5f6d-4f81-b43a-83fcb4ce0cf7'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:17 devstack sudo[91497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:37:17 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "cinder-f88f27ad-dc36-40dd-8418-43ed6b6c564b-delete_volume" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-f88f27ad-dc36-40dd-8418-43ed6b6c564b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "cinder-quobyte-f88f27ad-dc36-40dd-8418-43ed6b6c564b" by "delete_volume" {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-quobyte-f88f27ad-dc36-40dd-8418-43ed6b6c564b" acquired by "delete_volume" :: waited 0.007s {{(pid=82824) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b058fe-3c10-4bd0-9248-da8bbdd9334d]: (4, 'qcow2') {{(pid=83797) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:17 devstack sudo[91501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b
Apr 13 20:37:17 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:17 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.479s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:37:17 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Deleted volume successfully.
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-75b48e80-3a82-4c52-8508-cb1843b44bc0 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-f991e538-b5b0-49f1-b20e-7fc6f69e73df-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:17 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b" returned: 0 in 0.484s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:17 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:17 devstack sudo[91507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b
Apr 13 20:37:17 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:18 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77/volume-f88f27ad-dc36-40dd-8418-43ed6b6c564b" returned: 0 in 0.404s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-quobyte-f88f27ad-dc36-40dd-8418-43ed6b6c564b" released by "delete_volume" :: held 0.910s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG cinder.quota [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Created reservations ['4b7512a1-5282-485e-8c02-780539d205a7', 'bf63b20a-8ff0-46b0-91a7-9337998d4970', 'd3364511-4d73-40e7-a6c9-44d43b3ec810', 'fbd023e4-b4f8-493c-b0d9-862f98f8cecc'] {{(pid=82824) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b': None} {{(pid=82824) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG cinder.volume.drivers.quobyte [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-898da5f0-27ed-450c-8933-19cead12e64b'] {{(pid=82824) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.lockutils [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82824) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77 {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 20:37:18 devstack sudo[91510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77
Apr 13 20:37:18 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 20:37:18 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG oslo_concurrency.processutils [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a58fad66aa72db7316f4019ee25db77" returned: 0 in 0.465s {{(pid=82824) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG cinder.manager [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Notifying Schedulers of capabilities ... {{(pid=82824) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 20:37:18 devstack cinder-volume[82824]: INFO cinder.volume.manager [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Deleted volume successfully.
Apr 13 20:37:18 devstack cinder-volume[82824]: DEBUG cinder.coordination [None req-d2d9849a-1c68-48e9-9284-101e1d25ad45 tempest-CinderUnicodeTest-389852309 None] Lock "cinder-f88f27ad-dc36-40dd-8418-43ed6b6c564b-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=82824) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 20:37:28 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:UPDATE=297,cinder:DELETE=23,cinder:SELECT=203,cinder:INSERT=68 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 20:37:28 devstack cinder-volume[82824]: DEBUG dbcounter [-] [82824] Writing DB stats cinder:SELECT=58,cinder:INSERT=21,cinder:UPDATE=89,cinder:DELETE=7 {{(pid=82824) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}